-- Logs begin at Mon 2022-09-26 09:50:54 UTC, end at Mon 2022-09-26 10:51:25 UTC. -- Sep 26 10:18:08.723115 dv-cinder-844563-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 26 10:18:08.730400 dv-cinder-844563-7-smb devstack@keystone.service[81422]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 26 10:18:08.732410 dv-cinder-844563-7-smb devstack@keystone.service[81422]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 10:18:08 2022] *** Sep 26 10:18:08.732410 dv-cinder-844563-7-smb devstack@keystone.service[81422]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 10:18:08.732410 dv-cinder-844563-7-smb devstack@keystone.service[81422]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 10:18:08.732410 dv-cinder-844563-7-smb devstack@keystone.service[81422]: nodename: dv-cinder-844563-7-smb Sep 26 10:18:08.732410 dv-cinder-844563-7-smb devstack@keystone.service[81422]: machine: x86_64 Sep 26 10:18:08.732410 dv-cinder-844563-7-smb devstack@keystone.service[81422]: clock source: unix Sep 26 10:18:08.732410 dv-cinder-844563-7-smb devstack@keystone.service[81422]: pcre jit disabled Sep 26 10:18:08.732850 dv-cinder-844563-7-smb devstack@keystone.service[81422]: detected number of CPU cores: 4 Sep 26 10:18:08.732850 dv-cinder-844563-7-smb devstack@keystone.service[81422]: current working directory: / Sep 26 10:18:08.732850 dv-cinder-844563-7-smb devstack@keystone.service[81422]: detected binary path: /usr/bin/uwsgi-core Sep 26 10:18:08.732850 dv-cinder-844563-7-smb devstack@keystone.service[81422]: your processes number limit is 47680 Sep 26 10:18:08.732850 dv-cinder-844563-7-smb devstack@keystone.service[81422]: your memory page size is 4096 bytes Sep 26 10:18:08.732850 dv-cinder-844563-7-smb devstack@keystone.service[81422]: detected max file descriptor number: 2048 Sep 26 10:18:08.732850 dv-cinder-844563-7-smb devstack@keystone.service[81422]: lock engine: pthread robust mutexes Sep 26 10:18:08.732850 dv-cinder-844563-7-smb devstack@keystone.service[81422]: thunder lock: enabled Sep 26 10:18:08.732850 dv-cinder-844563-7-smb devstack@keystone.service[81422]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 26 10:18:08.732850 dv-cinder-844563-7-smb devstack@keystone.service[81422]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 10:18:08.773458 dv-cinder-844563-7-smb devstack@keystone.service[81422]: Python main interpreter initialized at 0x55d5b6b169c0 Sep 26 10:18:08.773458 dv-cinder-844563-7-smb devstack@keystone.service[81422]: python threads support enabled Sep 26 10:18:08.773458 dv-cinder-844563-7-smb devstack@keystone.service[81422]: your server socket listen backlog is limited to 100 connections Sep 26 10:18:08.773458 dv-cinder-844563-7-smb devstack@keystone.service[81422]: your mercy for graceful operations on workers is 90 seconds Sep 26 10:18:08.773857 dv-cinder-844563-7-smb devstack@keystone.service[81422]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 10:18:08.773940 dv-cinder-844563-7-smb devstack@keystone.service[81422]: *** Operational MODE: preforking *** Sep 26 10:18:08.774182 dv-cinder-844563-7-smb devstack@keystone.service[81422]: *** uWSGI is running in multiple interpreter mode *** Sep 26 10:18:08.774182 dv-cinder-844563-7-smb devstack@keystone.service[81422]: spawned uWSGI master process (pid: 81422) Sep 26 10:18:08.774383 dv-cinder-844563-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 26 10:18:08.780973 dv-cinder-844563-7-smb devstack@keystone.service[81422]: spawned uWSGI worker 1 (pid: 81436, cores: 1) Sep 26 10:18:08.780973 dv-cinder-844563-7-smb devstack@keystone.service[81422]: spawned uWSGI worker 2 (pid: 81437, cores: 1) Sep 26 10:18:08.780973 dv-cinder-844563-7-smb devstack@keystone.service[81422]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 10:18:13.004646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:18:13.004646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: from cryptography.utils import int_from_bytes Sep 26 10:18:13.005455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:18:13.005455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: from cryptography.utils import int_from_bytes Sep 26 10:18:13.005565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:18:13.005565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: from cryptography.utils import int_from_bytes Sep 26 10:18:13.005565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:18:13.005565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: from cryptography.utils import int_from_bytes Sep 26 10:18:13.055332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 10:18:13.055535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 10:18:13.055697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] command line args: [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 10:18:13.055961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 10:18:13.056136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ================================================================================ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 10:18:13.056389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] admin_token = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.056632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config_dir = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.056818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.056903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 10:18:13.057007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] config_source = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.057118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 10:18:13.057204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] debug = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.057317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] command line args: [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 10:18:13.057395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.057613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 10:18:13.057740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.057824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ================================================================================ {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 10:18:13.057895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.057982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] admin_token = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.058146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.058268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] config_dir = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.058391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.058495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.058609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] config_source = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.058710 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.058804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] debug = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.058898 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_config_append = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.058991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.059125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.059125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_dir = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.059315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.059409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.059514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.059636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.059748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.059843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.059923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.059994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.060110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.060223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.060315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_config_append = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.060385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.060509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.060589 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.060660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_dir = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.060736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_file = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.060817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.060970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.061061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.061226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.061309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.061475 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.061556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.061704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.061788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.061885 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.061969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.062050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.062168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.062292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.062413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.062537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.062686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.062823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.062992 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.063175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.063259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.063356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] publish_errors = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.063435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.063587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.063663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.063814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.063895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.063992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.064171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.064248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.064455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.064662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.064746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] standard_threads = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.064846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] publish_errors = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.064928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.065108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.065196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.065313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.065385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.065476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_journal = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.065554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.065634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_json = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.065738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.065816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_stderr = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.065968 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] use_syslog = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.066049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.066197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.066339 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] standard_threads = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.066419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.066488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.066655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.066722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.066833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.066917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.067011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] use_journal = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.067140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.067216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] use_json = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.067347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] use_stderr = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.067427 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.067508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] use_syslog = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.067609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.067742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:18:13.067853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.067997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.068079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.068239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.068326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.068499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.068577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.068738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.068820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.069011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.069093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.069254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.069331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.069486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.069572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.069730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.069813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.069972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.070053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.070205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.070282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.070452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.070528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.070687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.070765 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.070931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.071007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.071166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.071243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.071416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.071499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.071665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.071819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.071892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.071961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.072146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.072224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.072374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.072460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.072604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.072681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.072836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.072919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.073093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.073188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.073343 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.073420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.073588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.073665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.073819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.073904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.074050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.074126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.074293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.074368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.074526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.074613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.074759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.074835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.075006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.075083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.075767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.075864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.076001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.076083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.076235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.076311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.076465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.076550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.076694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.076771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.076922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.077046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.077172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.077262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.077409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.077486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.077645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.077720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.077872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.078024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.078097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.078167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.078324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.078410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.078553 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.078637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.078784 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.078860 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.079017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.079094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.079247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.079330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.079482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.079559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.079716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.079794 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.079945 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.080029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.080178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.080255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.080410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.080485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.080637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.080713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.080879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.080985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.081133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.081256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.081364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.081460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.081588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.081698 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.081822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.081927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.082059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.082173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.082289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.082367 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.082526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.082604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.082760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.082846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.083000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.083079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.083233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.083323 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.083479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.083555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.083722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.083803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.083955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.084036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.084187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.084265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.084421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.084501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.084664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.084742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.084900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.085036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.085159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.085240 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.085399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.085477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.085634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.085714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.085889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.085970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.086085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.086159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.086323 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.086405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.086557 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.086642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.086791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.086870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.087024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.087102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.087260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.087337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.087506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.087582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.087740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.087816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.087976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.088053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.088209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.088323 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.088445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.088530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.088677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.088761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.088912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.089029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.089167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.089245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.089393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.089467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.089613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.089693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.089842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.089933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.090074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.090162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.090304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.090383 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.090541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.090619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.090777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.091497 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.091585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.091656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.091803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.091882 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.092059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.092160 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.092270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.092358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.092504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.092583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.092747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.092834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.external = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.093005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.093099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.093259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.093337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.093502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.093590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.093737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.password = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.093823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.093967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] auth.token = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.094046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.094205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.094290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.094438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.094526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.external = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.094680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.094759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.094908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.094989 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.095154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.095242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.095399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.095479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.password = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.095631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.095716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] auth.token = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.095864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.095958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.096100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.096178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.096345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.096423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.096576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.096666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.096820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.096897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.097085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.097215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.097317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.097408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.097555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.097634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.097804 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.097889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.098040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.098128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.098286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.098405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.098540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.098619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.098784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.098872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.099021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.099101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.099273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.099350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.099529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.099619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.099765 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.099844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.100001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.100087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.100247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.100335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.100493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.100573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.100727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.100805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.100991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.101077 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.101231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.101311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.101484 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.101563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.101719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.101800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.101968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.102048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.102203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.102282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.102436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.102515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.102670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.102748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.102908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.102986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.103153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.103232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.103387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.103466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.103620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.103698 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.103868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.103950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.104100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.104180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.104334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.104413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.104580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.104659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.104825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.104903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.105078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.105158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.105312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.105402 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.105545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.105663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.105775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.105854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.106013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.106093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.106256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.106335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.106527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.106610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.106761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.106841 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.106993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.107072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.107225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.107304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.107469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.107549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.107696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.107774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.107931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.108010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.108161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.108241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.108395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.108516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.108634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.108714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.108872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.108981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.109140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.109220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.109371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.109463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.109609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.109688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.109843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.109922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.110073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.110159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.110312 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.110391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.110554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.110633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.110781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.110867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.111017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.111098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.111246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.111325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.111481 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.111568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.111716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.111796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.111958 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.112037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.112195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.112286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.112426 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.112504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.112665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.112751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.112896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.113031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.113159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.113259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.113394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.113496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.113638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.113749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.113874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.113998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.114111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.114236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.114359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.114471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.114606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.114706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.114838 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.114938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.115069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.115178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.115319 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.115435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.115567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.115667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.115802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.115912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.116037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.116157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.116273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.116401 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.116505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.116634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.116745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.116864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.117025 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.117129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.117260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.117352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.117509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.117589 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.117756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.117835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.118002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.118089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.118236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.118316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.118468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.118586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.118703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.118792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.118938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.119018 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.119174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.119253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.119405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.119493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.119639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.119717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.119875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.119954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.120109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.120197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.120344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.120423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.120586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.120666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.120817 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.120905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.121076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.121157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.121313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.121391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.121550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.121643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.121785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.121863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.122020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.122599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.122781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.122868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.123018 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.123129 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.123263 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.123375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.123503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.123642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.123723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.123877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.123956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.124122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.124201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.124361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.124441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.124599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.124678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.124837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.124916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.125111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.125194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.125356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.125435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.125588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.125674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.125822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.125901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.126056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.126134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.126294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.126382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.126528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.126608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.126765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.126843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.126993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.127147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.127222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.127293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.127472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.127552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.127717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.127803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.127955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.128035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.128195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.128274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.128433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] role.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.128521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.128674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.128756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] role.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.128904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.129023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.129159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.129250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.129405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.129485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.129650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.129729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.129893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.129979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.130137 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.130217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.130381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.130526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.130630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.130767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.130880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.131022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.131101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.131277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.131356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.131531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.131611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.131781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.131861 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.132022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.132110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.132275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.132430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.132509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.132668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.132746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.132920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.133028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.133199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.133279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.133433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.133512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.133683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.133765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.133917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.133995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.134173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.134251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.134409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.134490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.134643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.134722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.134873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.134952 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.135106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.135202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.135342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.135433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.135583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.135664 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.135817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.135898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.136070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.136148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.136308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.136387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.136539 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.136724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.136817 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.136890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.137013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.137095 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.137254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.137336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.137485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.137563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.137743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.138304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.138491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.138572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.138739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.138901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.138968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.139039 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.139207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.139292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.139448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.139536 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.139696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.139776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.139933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.140020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.140174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.140253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.140410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.140488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.140642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.140728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.140882 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.141006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.141139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.141219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.141375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.141464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.141608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.141695 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.141842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.141921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.connection = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.142090 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.142169 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.142324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.142411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.142565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.142645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.142799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.142878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.143038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.143125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.143272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.143350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.143514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.143592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.143742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.143829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.143983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.144063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.144217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.144296 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.144417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 10:18:13.144502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.144686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.144934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.145193 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.145438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.145671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.145913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.146149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:18:13.146320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 10:18:13.173443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.173671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.173897 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.175107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.175343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.175572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.182142 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.183832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.211719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.211948 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.212650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.212886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.265319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.265499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.313530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.313764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.313880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.314125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.469499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.469686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.469770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.469845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.469940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.470018 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.470152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.470243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.470367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.470499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.470571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.470633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.493125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.493362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.493568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.493672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.493803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.493887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.494019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.494102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.494237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.494322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.494453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.494534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.494668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.494883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.505499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.505728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.518460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.518648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.518768 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.518876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.518955 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.519080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.519164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.519301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.519393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.519518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.519601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.519732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.519816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.519969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81437) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 10:18:13.537086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.537298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 10:18:13.537603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.537687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.537812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 10:18:13.537904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 10:18:13.538080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.538159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.538332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 10:18:13.538412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.538590 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.538670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.538848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.538928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.539103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.539356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.548410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.548692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.548888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.548987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.549194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.549289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.549462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.549742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.556185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.556615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.559108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.559396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.559509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.559704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.559826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.559990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.560111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.560275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.560397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.560536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.560681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.560804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.560941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.561102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.561231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.561372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.561503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.561648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.561772 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.561916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.562043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.562308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.584889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.585352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.586374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.586661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.586799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.587085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.591377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.591667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.591748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.591953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.592045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.592297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.598276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.598564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.598645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.598881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.604098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.604395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.604476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.604688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.604770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.604992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.605074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.605278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.605358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.605552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.605642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.605823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.605902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.606098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.606179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.606364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.621964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.622700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.622789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.622966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.626582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.626754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.629780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.629929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.630081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.630222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.634222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.634405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.637304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.637531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.640499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.640740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.640823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.641066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.641149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.641353 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.641447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.641635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.641715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.641913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.641992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.642201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.657822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.658108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.658381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.658460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.658646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.658738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.658935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.659197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.665496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.665995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.667077 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.667539 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.668583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.668862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.669574 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.669850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.672048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.672335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.672543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.672666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.672838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.672930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.673143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.673295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.673424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.673816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.684420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.685342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.685430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.685630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.685711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.685910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.685991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.686200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.686279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.686562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.686659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.686840 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.686929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.687119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.702216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.702382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.705151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.705286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.708023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.708152 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.709504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.709692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.710970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.711147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.711255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.711430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.711661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.711822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.718062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.718188 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.719536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.719626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.722434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.722518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.722834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.722915 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.723122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.723214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.723393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.723473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.731154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.731237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.731959 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.732061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.732241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.732322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.739092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81437) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.739193 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 10:18:13.739376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.739457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.739662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.739763 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.739934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.740024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.740214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.740294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.740484 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.740565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.740757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.740888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.741059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.741138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.741321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.741403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.741599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.741679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.741869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.741991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.742127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.742205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.742389 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.742468 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.742754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81437) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.742841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 10:18:13.777168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d5b6b169c0 pid: 81437 (default app) Sep 26 10:18:13.777313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d5b6b169c0 pid: 81436 (default app) Sep 26 10:18:13.780899 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4ea10-29c7-4185-8e15-0a6ade7736a5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:13.781205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4ea10-29c7-4185-8e15-0a6ade7736a5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:13.781478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4ea10-29c7-4185-8e15-0a6ade7736a5 None None] PATH_INFO: `/v3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:13.785567 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon Sep 26 10:18:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:20.469804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c9f0c-329d-4861-85fd-43fdd40510d0 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:20.470293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c9f0c-329d-4861-85fd-43fdd40510d0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:20.470380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c9f0c-329d-4861-85fd-43fdd40510d0 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:20.474560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:18:20.479989 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e96795-afb6-4f53-9854-00467348a27f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:20.480515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e96795-afb6-4f53-9854-00467348a27f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:20.480515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e96795-afb6-4f53-9854-00467348a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:20.551904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: INFO dbcounter [None req-69e96795-afb6-4f53-9854-00467348a27f None None] Registered counter for database keystone Sep 26 10:18:20.571034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG oslo_db.sqlalchemy.engines [None req-69e96795-afb6-4f53-9854-00467348a27f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:18:20.577209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writer thread running {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:18:20.754975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG passlib.handlers.bcrypt [None req-69e96795-afb6-4f53-9854-00467348a27f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81437) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 10:18:20.755274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG passlib.handlers.bcrypt [None req-69e96795-afb6-4f53-9854-00467348a27f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81437) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 10:18:20.813124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-69e96795-afb6-4f53-9854-00467348a27f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:20.814723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-69e96795-afb6-4f53-9854-00467348a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:20.939145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 10:18:21.392417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c9f0c-329d-4861-85fd-43fdd40510d0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:21.461460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: INFO dbcounter [None req-fd0c9f0c-329d-4861-85fd-43fdd40510d0 None None] Registered counter for database keystone Sep 26 10:18:21.483202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG oslo_db.sqlalchemy.engines [None req-fd0c9f0c-329d-4861-85fd-43fdd40510d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:18:21.489275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writer thread running {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:18:21.605826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c9f0c-329d-4861-85fd-43fdd40510d0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:21.610604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c468d4-bb3a-4160-9e47-4d56df1bc7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:21.611222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c468d4-bb3a-4160-9e47-4d56df1bc7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:21.611501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c468d4-bb3a-4160-9e47-4d56df1bc7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:21.611774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c468d4-bb3a-4160-9e47-4d56df1bc7a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:21.619905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c468d4-bb3a-4160-9e47-4d56df1bc7a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:21.672573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d8c468d4-bb3a-4160-9e47-4d56df1bc7a3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 10:18:21.672911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c468d4-bb3a-4160-9e47-4d56df1bc7a3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:21.682279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Sep 26 10:18:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:18:21.688177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e96795-afb6-4f53-9854-00467348a27f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:21.705133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e96795-afb6-4f53-9854-00467348a27f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:21.709530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc9610-8790-4312-9cf2-42eb4ed4874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:21.710628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc9610-8790-4312-9cf2-42eb4ed4874e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:21.710912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc9610-8790-4312-9cf2-42eb4ed4874e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:21.711196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc9610-8790-4312-9cf2-42eb4ed4874e admin admin] PATH_INFO: `/v3/projects/5634981824594276a0bd3022cd78b5df` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:21.712769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc9610-8790-4312-9cf2-42eb4ed4874e admin admin] RBAC: Authorizing `identity:get_project(project_id=5634981824594276a0bd3022cd78b5df)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:21.766026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bbdc9610-8790-4312-9cf2-42eb4ed4874e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 10:18:21.766366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc9610-8790-4312-9cf2-42eb4ed4874e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:21.770849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Sep 26 10:18:21 2022] GET /identity/v3/projects/5634981824594276a0bd3022cd78b5df => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:23.861401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffb724-3f48-4fbd-8ae1-01a7a0be93f2 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:23.861938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffb724-3f48-4fbd-8ae1-01a7a0be93f2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:23.861938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffb724-3f48-4fbd-8ae1-01a7a0be93f2 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:23.865999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:23.871271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a08460-5356-4917-9321-a084f6421719 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:23.872155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a08460-5356-4917-9321-a084f6421719 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:23.872330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a08460-5356-4917-9321-a084f6421719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:23.892535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-05a08460-5356-4917-9321-a084f6421719 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:23.894071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-05a08460-5356-4917-9321-a084f6421719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:23.902068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 10:18:24.164771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffb724-3f48-4fbd-8ae1-01a7a0be93f2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:24.177594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffb724-3f48-4fbd-8ae1-01a7a0be93f2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:24.181710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e272e6d-7a1b-4b12-8af2-f901b46bdcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:24.182298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e272e6d-7a1b-4b12-8af2-f901b46bdcfa admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:24.182573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e272e6d-7a1b-4b12-8af2-f901b46bdcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:24.182843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e272e6d-7a1b-4b12-8af2-f901b46bdcfa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:24.190294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e272e6d-7a1b-4b12-8af2-f901b46bdcfa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:24.192033 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e272e6d-7a1b-4b12-8af2-f901b46bdcfa admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:24.201007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Sep 26 10:18:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:18:24.206028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a08460-5356-4917-9321-a084f6421719 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:24.215036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a08460-5356-4917-9321-a084f6421719 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:24.219905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf2144-2806-472d-9bcc-2ea5eecea889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:24.220527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf2144-2806-472d-9bcc-2ea5eecea889 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:24.220809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf2144-2806-472d-9bcc-2ea5eecea889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:24.221129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf2144-2806-472d-9bcc-2ea5eecea889 admin admin] PATH_INFO: `/v3/users/d64b74222381414fa028861d4cb5842c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:24.222430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf2144-2806-472d-9bcc-2ea5eecea889 admin admin] RBAC: Authorizing `identity:get_user(user_id=d64b74222381414fa028861d4cb5842c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:24.224228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf2144-2806-472d-9bcc-2ea5eecea889 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:24.225773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Sep 26 10:18:24 2022] GET /identity/v3/users/d64b74222381414fa028861d4cb5842c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:26.433426 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984b5e-a84e-4f79-bc97-c634323a57df None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:26.434520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984b5e-a84e-4f79-bc97-c634323a57df None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:26.434520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984b5e-a84e-4f79-bc97-c634323a57df None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:26.435834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:18:26.441030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed659a7c-e4b0-4e15-8432-98b95a69e273 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:26.441415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed659a7c-e4b0-4e15-8432-98b95a69e273 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:26.441704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed659a7c-e4b0-4e15-8432-98b95a69e273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:26.459470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ed659a7c-e4b0-4e15-8432-98b95a69e273 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:26.460643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ed659a7c-e4b0-4e15-8432-98b95a69e273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:26.475010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd424fa7-099b-4072-b469-183b8957924e None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:26.475420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd424fa7-099b-4072-b469-183b8957924e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:26.475760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd424fa7-099b-4072-b469-183b8957924e None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:26.477156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:18:26.482615 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1f36c-e0ad-4a77-bfea-075ae6cac9c0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:26.482897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1f36c-e0ad-4a77-bfea-075ae6cac9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:26.483171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1f36c-e0ad-4a77-bfea-075ae6cac9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:26.524391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG passlib.handlers.bcrypt [None req-fbf1f36c-e0ad-4a77-bfea-075ae6cac9c0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81436) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 10:18:26.524777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG passlib.handlers.bcrypt [None req-fbf1f36c-e0ad-4a77-bfea-075ae6cac9c0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81436) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 10:18:26.541167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:26.574209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-fbf1f36c-e0ad-4a77-bfea-075ae6cac9c0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:26.575793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fbf1f36c-e0ad-4a77-bfea-075ae6cac9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:26.676313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:18:26.812971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed659a7c-e4b0-4e15-8432-98b95a69e273 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:26.836189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:26.919835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed659a7c-e4b0-4e15-8432-98b95a69e273 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:26.943280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1f36c-e0ad-4a77-bfea-075ae6cac9c0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:26.954562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07194e-1b08-4d4a-b8e5-327a72e06b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:26.955512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07194e-1b08-4d4a-b8e5-327a72e06b67 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:26.955802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07194e-1b08-4d4a-b8e5-327a72e06b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:26.956082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07194e-1b08-4d4a-b8e5-327a72e06b67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:26.967889 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07194e-1b08-4d4a-b8e5-327a72e06b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2d07194e-1b08-4d4a-b8e5-327a72e06b67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:26.976659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:26.977606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:18:26.978503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:18:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:26.983643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07194e-1b08-4d4a-b8e5-327a72e06b67 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:27.049584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1f36c-e0ad-4a77-bfea-075ae6cac9c0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:27.051850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:27.075052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:27.088543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6dca9-4cf8-41de-a308-7c5f2b7230e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:27.089431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6dca9-4cf8-41de-a308-7c5f2b7230e8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:27.089718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6dca9-4cf8-41de-a308-7c5f2b7230e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:27.090544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6dca9-4cf8-41de-a308-7c5f2b7230e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:27.093585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07194e-1b08-4d4a-b8e5-327a72e06b67 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:27.126648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5140fa3-924f-47f2-85ab-0900b3f825a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:27.127253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5140fa3-924f-47f2-85ab-0900b3f825a6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:27.127535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5140fa3-924f-47f2-85ab-0900b3f825a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:27.127808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5140fa3-924f-47f2-85ab-0900b3f825a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:27.128470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5140fa3-924f-47f2-85ab-0900b3f825a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:27.128781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5140fa3-924f-47f2-85ab-0900b3f825a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:27.130205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5140fa3-924f-47f2-85ab-0900b3f825a6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:27.142285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:27.148030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5140fa3-924f-47f2-85ab-0900b3f825a6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:27.157276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6dca9-4cf8-41de-a308-7c5f2b7230e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:27.158782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6dca9-4cf8-41de-a308-7c5f2b7230e8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:27.244029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5140fa3-924f-47f2-85ab-0900b3f825a6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:27.252408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 10:18:27.257879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6dca9-4cf8-41de-a308-7c5f2b7230e8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:27.260541 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:27.279503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4612cc-e1e9-4d4a-ae94-b2eb74e286a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:27.280143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4612cc-e1e9-4d4a-ae94-b2eb74e286a7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:27.280429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4612cc-e1e9-4d4a-ae94-b2eb74e286a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:27.280705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4612cc-e1e9-4d4a-ae94-b2eb74e286a7 None admin] PATH_INFO: `/v3/users/d64b74222381414fa028861d4cb5842c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:27.281892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4612cc-e1e9-4d4a-ae94-b2eb74e286a7 None admin] RBAC: Authorizing `identity:get_user(user_id=d64b74222381414fa028861d4cb5842c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:27.283353 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4612cc-e1e9-4d4a-ae94-b2eb74e286a7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:27.284909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:27 2022] GET /identity/v3/users/d64b74222381414fa028861d4cb5842c => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:27.290283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4612cc-e1e9-4d4a-ae94-b2eb74e286a7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:27.306585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:27.356457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6dca9-4cf8-41de-a308-7c5f2b7230e8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:27.390429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a96c6-8c2d-4cfc-832e-d82c9bc45039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:27.391378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a96c6-8c2d-4cfc-832e-d82c9bc45039 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:27.391728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a96c6-8c2d-4cfc-832e-d82c9bc45039 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:27.392068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a96c6-8c2d-4cfc-832e-d82c9bc45039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:27.394670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4612cc-e1e9-4d4a-ae94-b2eb74e286a7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:27.411136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a96c6-8c2d-4cfc-832e-d82c9bc45039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:27.412594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a96c6-8c2d-4cfc-832e-d82c9bc45039 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:27.430786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd743-8b02-4f44-8455-c93321bd967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:27.431404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd743-8b02-4f44-8455-c93321bd967f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:27.431682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd743-8b02-4f44-8455-c93321bd967f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:27.431951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd743-8b02-4f44-8455-c93321bd967f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a17a96c6-8c2d-4cfc-832e-d82c9bc45039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:18:27.432146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:27.433245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:18:27.434676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:18:27.434676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:18:27.434676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:27.434676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:18:27.435766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd743-8b02-4f44-8455-c93321bd967f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:27.437267 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd743-8b02-4f44-8455-c93321bd967f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:27.438820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:27.438925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a96c6-8c2d-4cfc-832e-d82c9bc45039 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:27.444309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd743-8b02-4f44-8455-c93321bd967f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:27.493700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:27.523875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:27.537825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a96c6-8c2d-4cfc-832e-d82c9bc45039 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:27.543429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd743-8b02-4f44-8455-c93321bd967f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:27.570609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b7063-33bb-4683-bf55-f7142f67b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:27.571208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7063-33bb-4683-bf55-f7142f67b618 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:27.571489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7063-33bb-4683-bf55-f7142f67b618 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:27.571948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7063-33bb-4683-bf55-f7142f67b618 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:27.572399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b7063-33bb-4683-bf55-f7142f67b618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:27.572701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b7063-33bb-4683-bf55-f7142f67b618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:27.574137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b7063-33bb-4683-bf55-f7142f67b618 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:27.576599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53598406-ea5d-48d2-a0c0-3ecaee0759e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:27.577229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53598406-ea5d-48d2-a0c0-3ecaee0759e9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:27.577512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53598406-ea5d-48d2-a0c0-3ecaee0759e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:27.577783 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53598406-ea5d-48d2-a0c0-3ecaee0759e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:27.578515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53598406-ea5d-48d2-a0c0-3ecaee0759e9 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.domain.id=default, user.id=d64b74222381414fa028861d4cb5842c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:27.578823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53598406-ea5d-48d2-a0c0-3ecaee0759e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:27.580266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53598406-ea5d-48d2-a0c0-3ecaee0759e9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:27.586716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Sep 26 10:18:27 2022] GET /identity/v3/role_assignments?user.id=d64b74222381414fa028861d4cb5842c&scope.domain.id=default&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:27.591623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:30.116515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e79ec-0ae3-4420-a5db-73078bcc3542 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:30.117594 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e79ec-0ae3-4420-a5db-73078bcc3542 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:30.118093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e79ec-0ae3-4420-a5db-73078bcc3542 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:30.119622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:30.124901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ca2f9-1c44-47a5-8c04-b61328876993 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:30.125748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ca2f9-1c44-47a5-8c04-b61328876993 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:30.126220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ca2f9-1c44-47a5-8c04-b61328876993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:30.155044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8d7ca2f9-1c44-47a5-8c04-b61328876993 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:30.156247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8d7ca2f9-1c44-47a5-8c04-b61328876993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:30.255222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:30.491936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050314a-853c-4f78-8ee7-fadeadcbe1e2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:30.492540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050314a-853c-4f78-8ee7-fadeadcbe1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:30.493033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050314a-853c-4f78-8ee7-fadeadcbe1e2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:30.494555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:30.505048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf92766-5f68-46a1-bfdc-5b27e2d2fc6c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:30.505343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf92766-5f68-46a1-bfdc-5b27e2d2fc6c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:30.505624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf92766-5f68-46a1-bfdc-5b27e2d2fc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:30.529886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-faf92766-5f68-46a1-bfdc-5b27e2d2fc6c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:30.531070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-faf92766-5f68-46a1-bfdc-5b27e2d2fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:30.549079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab171ac-7aaf-4747-b49c-5c8c4f4f3a0f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:30.549730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab171ac-7aaf-4747-b49c-5c8c4f4f3a0f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:30.550198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab171ac-7aaf-4747-b49c-5c8c4f4f3a0f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:30.551725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 14/25] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:18:30.559035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db75979-1698-41fd-a85d-e67662ccfbd8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:30.559571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db75979-1698-41fd-a85d-e67662ccfbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:30.560060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db75979-1698-41fd-a85d-e67662ccfbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:30.597289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:30.602187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2db75979-1698-41fd-a85d-e67662ccfbd8 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:30.603144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2db75979-1698-41fd-a85d-e67662ccfbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:30.642928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 12/26] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:30.734770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 15/27] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:18:30.843522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf92766-5f68-46a1-bfdc-5b27e2d2fc6c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:30.931643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db75979-1698-41fd-a85d-e67662ccfbd8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:31.000460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf92766-5f68-46a1-bfdc-5b27e2d2fc6c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:31.053339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:31.081629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db75979-1698-41fd-a85d-e67662ccfbd8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:31.085835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bb40e-b2ff-45e5-8227-7d2e39016620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:31.086485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bb40e-b2ff-45e5-8227-7d2e39016620 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.086769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bb40e-b2ff-45e5-8227-7d2e39016620 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.087196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bb40e-b2ff-45e5-8227-7d2e39016620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.119018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bb40e-b2ff-45e5-8227-7d2e39016620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:31.127940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2260e-b4f0-414a-8df7-42f7940d0317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:31.129100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2260e-b4f0-414a-8df7-42f7940d0317 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.129520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2260e-b4f0-414a-8df7-42f7940d0317 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.129929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2260e-b4f0-414a-8df7-42f7940d0317 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.130756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2260e-b4f0-414a-8df7-42f7940d0317 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:31.132288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2260e-b4f0-414a-8df7-42f7940d0317 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-328bb40e-b2ff-45e5-8227-7d2e39016620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:31.138021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:31.139287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:31.140199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:31.143430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 13/28] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:31.147027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2bc24-87a1-4231-b909-aa8878214379 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.147462 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2bc24-87a1-4231-b909-aa8878214379 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.147933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2bc24-87a1-4231-b909-aa8878214379 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.149455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 14/29] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:31.154716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2bc24-87a1-4231-b909-aa8878214379 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:31.202603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:31.276628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2bc24-87a1-4231-b909-aa8878214379 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:31.308053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 16/30] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Sep 26 10:18:30 2022] POST /identity/v3/roles => generated 225 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:18:31.310729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e806ff-accf-4ed1-9cc8-603c678f7cb8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.311229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e806ff-accf-4ed1-9cc8-603c678f7cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.311833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e806ff-accf-4ed1-9cc8-603c678f7cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.313318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f18c8-3634-48a4-bd96-7ac9d5897551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:31.313999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f18c8-3634-48a4-bd96-7ac9d5897551 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.314288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f18c8-3634-48a4-bd96-7ac9d5897551 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.314565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f18c8-3634-48a4-bd96-7ac9d5897551 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.315325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f18c8-3634-48a4-bd96-7ac9d5897551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:31.315633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f18c8-3634-48a4-bd96-7ac9d5897551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:31.317118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f18c8-3634-48a4-bd96-7ac9d5897551 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:31.331768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 15/31] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:31.332701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f18c8-3634-48a4-bd96-7ac9d5897551 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:31.336568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b8e806ff-accf-4ed1-9cc8-603c678f7cb8 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:31.339157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b8e806ff-accf-4ed1-9cc8-603c678f7cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:31.442312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 17/32] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:31.448689 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e806ff-accf-4ed1-9cc8-603c678f7cb8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:31.480987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:31.490210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f18c8-3634-48a4-bd96-7ac9d5897551 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:31.535850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b966445-fe8a-4b08-8234-fe4e1ee8fef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:31.536500 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b966445-fe8a-4b08-8234-fe4e1ee8fef5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.536788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b966445-fe8a-4b08-8234-fe4e1ee8fef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.537292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b966445-fe8a-4b08-8234-fe4e1ee8fef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.549245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b966445-fe8a-4b08-8234-fe4e1ee8fef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:31.550791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b966445-fe8a-4b08-8234-fe4e1ee8fef5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:31.568117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4b966445-fe8a-4b08-8234-fe4e1ee8fef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:18:31.568591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:31.569599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:18:31.570410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:18:31.570410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:18:31.570410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:31.570410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 16/33] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:31.571906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4ef9-a241-46cc-a05a-7dcaeeb85fcf None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.572010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4ef9-a241-46cc-a05a-7dcaeeb85fcf None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.572572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4ef9-a241-46cc-a05a-7dcaeeb85fcf None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.573571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 17/34] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:31.580370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a4ef9-a241-46cc-a05a-7dcaeeb85fcf None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:31.628701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e806ff-accf-4ed1-9cc8-603c678f7cb8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:31.669070 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1a24-dd02-4fdd-9b60-244798e470e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:31.670294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1a24-dd02-4fdd-9b60-244798e470e6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.670988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1a24-dd02-4fdd-9b60-244798e470e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.671694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1a24-dd02-4fdd-9b60-244798e470e6 None admin] PATH_INFO: `/v3/users/d64b74222381414fa028861d4cb5842c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.673637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c1a24-dd02-4fdd-9b60-244798e470e6 None admin] RBAC: Authorizing `identity:get_user(user_id=d64b74222381414fa028861d4cb5842c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:31.675465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c1a24-dd02-4fdd-9b60-244798e470e6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:31.677475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 18/35] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:31 2022] GET /identity/v3/users/d64b74222381414fa028861d4cb5842c => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:31.679067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33c275-d62c-44cc-8be8-7363b69bc5c4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.679560 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33c275-d62c-44cc-8be8-7363b69bc5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.680034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33c275-d62c-44cc-8be8-7363b69bc5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.701924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ff33c275-d62c-44cc-8be8-7363b69bc5c4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:31.703394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ff33c275-d62c-44cc-8be8-7363b69bc5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:31.708893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a4ef9-a241-46cc-a05a-7dcaeeb85fcf None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:31.757051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4492-dfbe-46e4-ac8f-1c51745f6e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:31.757733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4492-dfbe-46e4-ac8f-1c51745f6e55 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.758016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4492-dfbe-46e4-ac8f-1c51745f6e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.758292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4492-dfbe-46e4-ac8f-1c51745f6e55 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.759621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf4492-dfbe-46e4-ac8f-1c51745f6e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:31.759933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf4492-dfbe-46e4-ac8f-1c51745f6e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:31.762184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf4492-dfbe-46e4-ac8f-1c51745f6e55 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:31.778107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 18/36] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:31.778770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4492-dfbe-46e4-ac8f-1c51745f6e55 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:31.786576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 19/37] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:31.787479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33c275-d62c-44cc-8be8-7363b69bc5c4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:31.796919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:31.855796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:31.900261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33c275-d62c-44cc-8be8-7363b69bc5c4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:31.916747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4492-dfbe-46e4-ac8f-1c51745f6e55 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:31.939348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beee207-d8ac-4dff-b05b-4ad7cde664d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:31.940159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beee207-d8ac-4dff-b05b-4ad7cde664d7 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.940515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beee207-d8ac-4dff-b05b-4ad7cde664d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.941145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beee207-d8ac-4dff-b05b-4ad7cde664d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.941728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beee207-d8ac-4dff-b05b-4ad7cde664d7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:31.943194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beee207-d8ac-4dff-b05b-4ad7cde664d7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:31.963175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 20/38] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Sep 26 10:18:31 2022] POST /identity/v3/roles => generated 219 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:18:31.964221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beee207-d8ac-4dff-b05b-4ad7cde664d7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:31.964324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b900832-1791-4f2c-9e2e-7ced7deefed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:31.965891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900832-1791-4f2c-9e2e-7ced7deefed1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:31.966250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900832-1791-4f2c-9e2e-7ced7deefed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:31.966642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900832-1791-4f2c-9e2e-7ced7deefed1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:31.968659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b900832-1791-4f2c-9e2e-7ced7deefed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:31.971388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b900832-1791-4f2c-9e2e-7ced7deefed1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:31.973661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 19/39] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:31.984743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b900832-1791-4f2c-9e2e-7ced7deefed1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:32.120334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:32.133184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beee207-d8ac-4dff-b05b-4ad7cde664d7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:32.148792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b900832-1791-4f2c-9e2e-7ced7deefed1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:32.160590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:32.176044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020f1f-1f99-4d79-b5a0-bff353b29cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:32.176819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020f1f-1f99-4d79-b5a0-bff353b29cb4 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:32.177176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020f1f-1f99-4d79-b5a0-bff353b29cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:32.177565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020f1f-1f99-4d79-b5a0-bff353b29cb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:32.178223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020f1f-1f99-4d79-b5a0-bff353b29cb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:32.179678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020f1f-1f99-4d79-b5a0-bff353b29cb4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:32.189782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2eeebe-8a31-4cd6-b6cb-db3ce44f0944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:32.190458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eeebe-8a31-4cd6-b6cb-db3ce44f0944 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:32.190744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eeebe-8a31-4cd6-b6cb-db3ce44f0944 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:32.191023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eeebe-8a31-4cd6-b6cb-db3ce44f0944 None admin] PATH_INFO: `/v3/domains/default/users/d64b74222381414fa028861d4cb5842c/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:32.193170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2eeebe-8a31-4cd6-b6cb-db3ce44f0944 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d64b74222381414fa028861d4cb5842c, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:32.194595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2eeebe-8a31-4cd6-b6cb-db3ce44f0944 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:32.212031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:18:31 2022] POST /identity/v3/projects => generated 301 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:18:32.213528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b57ab-69d0-4678-b9ed-f92767b0f23b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:32.213767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b57ab-69d0-4678-b9ed-f92767b0f23b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:32.214051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b57ab-69d0-4678-b9ed-f92767b0f23b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:32.215468 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 22/41] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:32.220754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b57ab-69d0-4678-b9ed-f92767b0f23b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:32.323432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 20/42] 10.222.0.18 () {58 vars in 1361 bytes} [Mon Sep 26 10:18:31 2022] PUT /identity/v3/domains/default/users/d64b74222381414fa028861d4cb5842c/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:18:32.323432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b760-204f-408a-84db-6500020b94b7 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:32.323432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b760-204f-408a-84db-6500020b94b7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:32.323432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b760-204f-408a-84db-6500020b94b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:32.342161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-78b6b760-204f-408a-84db-6500020b94b7 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:32.343931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-78b6b760-204f-408a-84db-6500020b94b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:32.345722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b57ab-69d0-4678-b9ed-f92767b0f23b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:32.404828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32f43f-aa7a-4706-a4a0-54bc292e73f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:32.405893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32f43f-aa7a-4706-a4a0-54bc292e73f2 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:32.406471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32f43f-aa7a-4706-a4a0-54bc292e73f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:32.406810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32f43f-aa7a-4706-a4a0-54bc292e73f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:32.407514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32f43f-aa7a-4706-a4a0-54bc292e73f2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:32.409190 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32f43f-aa7a-4706-a4a0-54bc292e73f2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:32.438212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 23/43] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Sep 26 10:18:32 2022] POST /identity/v3/roles => generated 223 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:18:32.449123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 21/44] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:32.715690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32f43f-aa7a-4706-a4a0-54bc292e73f2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:32.750947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:32.921053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32f43f-aa7a-4706-a4a0-54bc292e73f2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:32.954465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac44c-100e-4eb1-b4c8-4d1bc51f931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:32.955088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac44c-100e-4eb1-b4c8-4d1bc51f931a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:32.955368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac44c-100e-4eb1-b4c8-4d1bc51f931a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:32.955640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac44c-100e-4eb1-b4c8-4d1bc51f931a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:32.956733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ac44c-100e-4eb1-b4c8-4d1bc51f931a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:32.958203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ac44c-100e-4eb1-b4c8-4d1bc51f931a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:32.959911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 24/45] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:32.965476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6b760-204f-408a-84db-6500020b94b7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:33.030152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:33.063680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6b760-204f-408a-84db-6500020b94b7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:33.200325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e7d0-f3b4-4391-a3e2-c928bcbc85c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:33.200996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e7d0-f3b4-4391-a3e2-c928bcbc85c4 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:33.201211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e7d0-f3b4-4391-a3e2-c928bcbc85c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:33.201482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e7d0-f3b4-4391-a3e2-c928bcbc85c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:33.202116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6e7d0-f3b4-4391-a3e2-c928bcbc85c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:33.203726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6e7d0-f3b4-4391-a3e2-c928bcbc85c4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:33.235484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 22/46] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:18:32 2022] POST /identity/v3/projects => generated 312 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:18:34.533224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bcd0-45f1-4d81-ab54-9cffc2faccfe None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:34.533754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bcd0-45f1-4d81-ab54-9cffc2faccfe None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:34.533835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bcd0-45f1-4d81-ab54-9cffc2faccfe None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:34.535152 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 25/47] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:34.540454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdeab6-3dcf-4d67-a73d-7b02983da3c3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:34.540860 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdeab6-3dcf-4d67-a73d-7b02983da3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:34.541044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdeab6-3dcf-4d67-a73d-7b02983da3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:34.559618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ebfdeab6-3dcf-4d67-a73d-7b02983da3c3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:34.560785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ebfdeab6-3dcf-4d67-a73d-7b02983da3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:34.623701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 23/48] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:18:34.894671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128bcd0-45f1-4d81-ab54-9cffc2faccfe None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:34.996211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128bcd0-45f1-4d81-ab54-9cffc2faccfe None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:34.997752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:35.030500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07c49-88f4-49c4-b9b9-0f0e4c0b4920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:35.031126 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07c49-88f4-49c4-b9b9-0f0e4c0b4920 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:35.031408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07c49-88f4-49c4-b9b9-0f0e4c0b4920 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:35.031678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07c49-88f4-49c4-b9b9-0f0e4c0b4920 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:35.041860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df07c49-88f4-49c4-b9b9-0f0e4c0b4920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8df07c49-88f4-49c4-b9b9-0f0e4c0b4920 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:35.047285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:35.048268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:18:35.049029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 26/49] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:35.054247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdeab6-3dcf-4d67-a73d-7b02983da3c3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:35.101559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:35.151407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdeab6-3dcf-4d67-a73d-7b02983da3c3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:35.184060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fc24f-0cbf-427e-b687-cdb28f9a3b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:35.184662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fc24f-0cbf-427e-b687-cdb28f9a3b48 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:35.184957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fc24f-0cbf-427e-b687-cdb28f9a3b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:35.185244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fc24f-0cbf-427e-b687-cdb28f9a3b48 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:35.186187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fc24f-0cbf-427e-b687-cdb28f9a3b48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:35.186493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fc24f-0cbf-427e-b687-cdb28f9a3b48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:35.187858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fc24f-0cbf-427e-b687-cdb28f9a3b48 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:35.195748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 24/50] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:35.201910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07c49-88f4-49c4-b9b9-0f0e4c0b4920 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:35.302052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07c49-88f4-49c4-b9b9-0f0e4c0b4920 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:35.334648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2d948-cc6d-4b81-b326-98701b4a91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:35.335279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2d948-cc6d-4b81-b326-98701b4a91b3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:35.335560 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2d948-cc6d-4b81-b326-98701b4a91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:35.335833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2d948-cc6d-4b81-b326-98701b4a91b3 None admin] PATH_INFO: `/v3/users/d64b74222381414fa028861d4cb5842c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:35.336938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2d948-cc6d-4b81-b326-98701b4a91b3 None admin] RBAC: Authorizing `identity:get_user(user_id=d64b74222381414fa028861d4cb5842c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:35.338397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2d948-cc6d-4b81-b326-98701b4a91b3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:35.340042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 27/51] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:35 2022] GET /identity/v3/users/d64b74222381414fa028861d4cb5842c => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:35.345614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fc24f-0cbf-427e-b687-cdb28f9a3b48 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:35.372495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f9dd5-e1d3-4d9d-b0d5-0bed3f55abb7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:35.372781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f9dd5-e1d3-4d9d-b0d5-0bed3f55abb7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:35.373121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f9dd5-e1d3-4d9d-b0d5-0bed3f55abb7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:35.374572 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 28/52] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:18:35.379219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac5c98-34e3-48a0-8502-49924dabd28d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:35.379504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac5c98-34e3-48a0-8502-49924dabd28d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:35.379779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac5c98-34e3-48a0-8502-49924dabd28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:35.397842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-daac5c98-34e3-48a0-8502-49924dabd28d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:35.399063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-daac5c98-34e3-48a0-8502-49924dabd28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:35.423690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:35.444685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fc24f-0cbf-427e-b687-cdb28f9a3b48 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:35.458515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:35.467411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 29/53] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:18:35.480502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dea7bf-cdc6-44f6-ab69-ff7c803fd7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:35.481175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea7bf-cdc6-44f6-ab69-ff7c803fd7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:35.481463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea7bf-cdc6-44f6-ab69-ff7c803fd7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:35.481740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea7bf-cdc6-44f6-ab69-ff7c803fd7a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:35.482863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dea7bf-cdc6-44f6-ab69-ff7c803fd7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:35.484290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dea7bf-cdc6-44f6-ab69-ff7c803fd7a6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:35.485887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 25/54] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:35.491501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac5c98-34e3-48a0-8502-49924dabd28d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:35.588272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac5c98-34e3-48a0-8502-49924dabd28d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:35.622069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981859b-7eb1-474b-af02-83dc9e955391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:35.622663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981859b-7eb1-474b-af02-83dc9e955391 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:35.622943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981859b-7eb1-474b-af02-83dc9e955391 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:35.623223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981859b-7eb1-474b-af02-83dc9e955391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:35.623941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981859b-7eb1-474b-af02-83dc9e955391 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.domain.id=default, user.id=d64b74222381414fa028861d4cb5842c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:35.624252 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981859b-7eb1-474b-af02-83dc9e955391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:35.625761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981859b-7eb1-474b-af02-83dc9e955391 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:35.631491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 30/55] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Sep 26 10:18:35 2022] GET /identity/v3/role_assignments?user.id=d64b74222381414fa028861d4cb5842c&scope.domain.id=default&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:35.732274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dea7bf-cdc6-44f6-ab69-ff7c803fd7a6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:35.835722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dea7bf-cdc6-44f6-ab69-ff7c803fd7a6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:35.868979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f12237-4427-4a5f-ade7-0693348d0dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:35.869628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f12237-4427-4a5f-ade7-0693348d0dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:35.869909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f12237-4427-4a5f-ade7-0693348d0dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:35.870180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f12237-4427-4a5f-ade7-0693348d0dc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:35.871746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f12237-4427-4a5f-ade7-0693348d0dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:35.873303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f12237-4427-4a5f-ade7-0693348d0dc1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:35.874862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 26/56] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:35.880509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981859b-7eb1-474b-af02-83dc9e955391 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:35.905604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:35.977484 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981859b-7eb1-474b-af02-83dc9e955391 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:36.010084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c9da7-b57a-45bb-881f-9c4d7f07933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:36.010611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9da7-b57a-45bb-881f-9c4d7f07933f None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:36.010891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9da7-b57a-45bb-881f-9c4d7f07933f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:36.011164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9da7-b57a-45bb-881f-9c4d7f07933f None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:36.011834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c9da7-b57a-45bb-881f-9c4d7f07933f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:36.013288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c9da7-b57a-45bb-881f-9c4d7f07933f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:36.038345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 31/57] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Sep 26 10:18:35 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:18:38.175094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1628719-4480-41cc-a868-09230d202db5 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:38.175615 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1628719-4480-41cc-a868-09230d202db5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:38.175697 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1628719-4480-41cc-a868-09230d202db5 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:38.177014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 27/58] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:38.182119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6b604-edc2-4a8e-8c00-094d3a5e2c61 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:38.182535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6b604-edc2-4a8e-8c00-094d3a5e2c61 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:38.182676 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6b604-edc2-4a8e-8c00-094d3a5e2c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:38.200597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b4d6b604-edc2-4a8e-8c00-094d3a5e2c61 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:38.201806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b4d6b604-edc2-4a8e-8c00-094d3a5e2c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:38.264726 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 32/59] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:38.539521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1628719-4480-41cc-a868-09230d202db5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:38.588741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:38.639694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1628719-4480-41cc-a868-09230d202db5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:38.672154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15e66c-1ec5-4d33-ade5-9e000c9cade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:38.672779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e66c-1ec5-4d33-ade5-9e000c9cade0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:38.673093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e66c-1ec5-4d33-ade5-9e000c9cade0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:38.673372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e66c-1ec5-4d33-ade5-9e000c9cade0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:38.674480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15e66c-1ec5-4d33-ade5-9e000c9cade0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:38.675903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15e66c-1ec5-4d33-ade5-9e000c9cade0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:38.677751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 28/60] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:38.683730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6b604-edc2-4a8e-8c00-094d3a5e2c61 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:38.691612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:38.781945 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6b604-edc2-4a8e-8c00-094d3a5e2c61 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:38.814307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba2342-e4ce-4a3b-87bf-4750c81db109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:38.814850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba2342-e4ce-4a3b-87bf-4750c81db109 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:38.815132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba2342-e4ce-4a3b-87bf-4750c81db109 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:38.815406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba2342-e4ce-4a3b-87bf-4750c81db109 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:38.816055 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba2342-e4ce-4a3b-87bf-4750c81db109 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:38.817512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba2342-e4ce-4a3b-87bf-4750c81db109 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:38.842633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 33/61] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:18:38 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:18:42.221819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002074-39ab-4aee-b4b7-9de4b1f07337 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:42.222839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002074-39ab-4aee-b4b7-9de4b1f07337 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:42.223322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e002074-39ab-4aee-b4b7-9de4b1f07337 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:42.224897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 29/62] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:42.230958 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c03279-65e3-460f-a31f-1b6ae23f3be0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:42.231385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c03279-65e3-460f-a31f-1b6ae23f3be0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:42.231571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c03279-65e3-460f-a31f-1b6ae23f3be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:42.253196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-64c03279-65e3-460f-a31f-1b6ae23f3be0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:42.254412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-64c03279-65e3-460f-a31f-1b6ae23f3be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:42.317005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a3ae3-872c-4729-a58a-8726a0e5ab2d None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:42.317005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a3ae3-872c-4729-a58a-8726a0e5ab2d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:42.317005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a3ae3-872c-4729-a58a-8726a0e5ab2d None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:42.318422 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 30/63] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:42.334856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b23ba5-14fd-44b1-a529-76091e9bdef0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:42.335213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b23ba5-14fd-44b1-a529-76091e9bdef0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:42.335412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b23ba5-14fd-44b1-a529-76091e9bdef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:42.373618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-08b23ba5-14fd-44b1-a529-76091e9bdef0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:42.374820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-08b23ba5-14fd-44b1-a529-76091e9bdef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:42.377919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:42.401101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 34/64] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:42.460593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffbcad-fc61-4a2a-9e94-ff69b479e26e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:42.461249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffbcad-fc61-4a2a-9e94-ff69b479e26e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:42.461851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffbcad-fc61-4a2a-9e94-ff69b479e26e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:42.463415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 35/65] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:18:42.468684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66aff0-3638-4eaf-afe9-ca64242e9e6d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:42.469232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66aff0-3638-4eaf-afe9-ca64242e9e6d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:42.469709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66aff0-3638-4eaf-afe9-ca64242e9e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:42.479364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 31/66] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:18:42.480738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f08ca8-0e91-40a1-a526-02cd0a48fc9c None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:42.481055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f08ca8-0e91-40a1-a526-02cd0a48fc9c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:42.481337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f08ca8-0e91-40a1-a526-02cd0a48fc9c None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:42.482733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 32/67] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:42.488420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad0ee9-9064-4020-acaf-52908db65414 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:42.488723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad0ee9-9064-4020-acaf-52908db65414 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:42.489008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad0ee9-9064-4020-acaf-52908db65414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:42.490849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ba66aff0-3638-4eaf-afe9-ca64242e9e6d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:42.492245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ba66aff0-3638-4eaf-afe9-ca64242e9e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:42.531507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-95ad0ee9-9064-4020-acaf-52908db65414 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:42.533843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-95ad0ee9-9064-4020-acaf-52908db65414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:42.596930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 36/68] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:18:42.643481 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:42.676565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66aff0-3638-4eaf-afe9-ca64242e9e6d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:42.678891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 33/69] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 26 10:18:42.808236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66aff0-3638-4eaf-afe9-ca64242e9e6d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:42.832428 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:42.853775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9e07c-6e91-4731-b5db-3722d551e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:42.854415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e07c-6e91-4731-b5db-3722d551e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:42.854736 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e07c-6e91-4731-b5db-3722d551e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:42.855013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9e07c-6e91-4731-b5db-3722d551e3f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:42.864498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad0ee9-9064-4020-acaf-52908db65414 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:42.866331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9e07c-6e91-4731-b5db-3722d551e3f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-eeb9e07c-6e91-4731-b5db-3722d551e3f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:42.871469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:42.872413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:18:42.873631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 37/70] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:18:42.878845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9e07c-6e91-4731-b5db-3722d551e3f4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.009282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad0ee9-9064-4020-acaf-52908db65414 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.025307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9e07c-6e91-4731-b5db-3722d551e3f4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.041962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705091d-8500-446d-953a-dd105ae61407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.043123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705091d-8500-446d-953a-dd105ae61407 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.043404 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705091d-8500-446d-953a-dd105ae61407 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.043677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705091d-8500-446d-953a-dd105ae61407 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.053345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705091d-8500-446d-953a-dd105ae61407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a705091d-8500-446d-953a-dd105ae61407 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:43.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:43.059691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:18:43.060447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:43.061610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659cf50-0383-4dd5-86c4-01b1f170a4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.061610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659cf50-0383-4dd5-86c4-01b1f170a4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.061760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 34/71] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:18:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:43.061822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659cf50-0383-4dd5-86c4-01b1f170a4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.061822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659cf50-0383-4dd5-86c4-01b1f170a4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.061937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705091d-8500-446d-953a-dd105ae61407 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.062005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659cf50-0383-4dd5-86c4-01b1f170a4b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:43.062005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659cf50-0383-4dd5-86c4-01b1f170a4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:43.062834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659cf50-0383-4dd5-86c4-01b1f170a4b2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:43.071845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 38/72] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:18:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:43.073057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f169ac-ba3c-468c-a112-f888a7800b87 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.073345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f169ac-ba3c-468c-a112-f888a7800b87 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.073651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f169ac-ba3c-468c-a112-f888a7800b87 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.074831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 39/73] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:43.075530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f169ac-ba3c-468c-a112-f888a7800b87 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.099145 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:43.124194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:43.163949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705091d-8500-446d-953a-dd105ae61407 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.178389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f169ac-ba3c-468c-a112-f888a7800b87 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.197740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f012f80-91b0-421e-ad9f-27736183671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.198389 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f012f80-91b0-421e-ad9f-27736183671e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.198702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f012f80-91b0-421e-ad9f-27736183671e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.198978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f012f80-91b0-421e-ad9f-27736183671e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.208871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f012f80-91b0-421e-ad9f-27736183671e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:43.211382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3aee9-a31a-46ea-9c6e-81abdd165116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.212004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3aee9-a31a-46ea-9c6e-81abdd165116 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.212295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3aee9-a31a-46ea-9c6e-81abdd165116 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.212574 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3aee9-a31a-46ea-9c6e-81abdd165116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-0f012f80-91b0-421e-ad9f-27736183671e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:43.213753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:43.215130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:43.215868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 35/74] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:43.217612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f012f80-91b0-421e-ad9f-27736183671e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.223607 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3aee9-a31a-46ea-9c6e-81abdd165116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-51e3aee9-a31a-46ea-9c6e-81abdd165116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:43.228928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:43.229855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 40/75] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:43.233845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3aee9-a31a-46ea-9c6e-81abdd165116 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.310248 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:43.316477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f012f80-91b0-421e-ad9f-27736183671e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.329874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3aee9-a31a-46ea-9c6e-81abdd165116 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.332174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:43.350120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d975b-9fab-4e37-a3a0-e4f2a7c3398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.350733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d975b-9fab-4e37-a3a0-e4f2a7c3398e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.351020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d975b-9fab-4e37-a3a0-e4f2a7c3398e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.351298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d975b-9fab-4e37-a3a0-e4f2a7c3398e None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.351964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d975b-9fab-4e37-a3a0-e4f2a7c3398e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:43.352271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d975b-9fab-4e37-a3a0-e4f2a7c3398e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:43.355912 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d975b-9fab-4e37-a3a0-e4f2a7c3398e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:43.363100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c685c0d-f78b-4b6d-b5a4-8cc2ffa7f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.363728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c685c0d-f78b-4b6d-b5a4-8cc2ffa7f5ed None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.364007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c685c0d-f78b-4b6d-b5a4-8cc2ffa7f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.364279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c685c0d-f78b-4b6d-b5a4-8cc2ffa7f5ed None admin] PATH_INFO: `/v3/users/06e92989261641b38e78bcbed08924de` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.372111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 36/76] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:43.372111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c1b5-b2e6-4a7e-8541-d2b161764004 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.372111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c1b5-b2e6-4a7e-8541-d2b161764004 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.372111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c1b5-b2e6-4a7e-8541-d2b161764004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.378385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c685c0d-f78b-4b6d-b5a4-8cc2ffa7f5ed None admin] RBAC: Authorizing `identity:get_user(user_id=06e92989261641b38e78bcbed08924de)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:43.379826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c685c0d-f78b-4b6d-b5a4-8cc2ffa7f5ed None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:43.381488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 41/77] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/users/06e92989261641b38e78bcbed08924de => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:43.382229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c685c0d-f78b-4b6d-b5a4-8cc2ffa7f5ed None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.388374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e095c1b5-b2e6-4a7e-8541-d2b161764004 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:43.389595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e095c1b5-b2e6-4a7e-8541-d2b161764004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:43.453502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 37/78] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:43.454322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c1b5-b2e6-4a7e-8541-d2b161764004 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.483272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c685c0d-f78b-4b6d-b5a4-8cc2ffa7f5ed None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.516816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd1c9f-880d-4889-bae8-040ad21251d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.517441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd1c9f-880d-4889-bae8-040ad21251d0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.517719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd1c9f-880d-4889-bae8-040ad21251d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.517994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd1c9f-880d-4889-bae8-040ad21251d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.518649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd1c9f-880d-4889-bae8-040ad21251d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:43.518953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd1c9f-880d-4889-bae8-040ad21251d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:43.520351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd1c9f-880d-4889-bae8-040ad21251d0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:43.528446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 42/79] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:43.529250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd1c9f-880d-4889-bae8-040ad21251d0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.546688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:43.559487 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:43.560604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c1b5-b2e6-4a7e-8541-d2b161764004 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.594585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c4b70-3ea2-4f18-902f-84add02f4a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.595183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c4b70-3ea2-4f18-902f-84add02f4a3c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.595467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c4b70-3ea2-4f18-902f-84add02f4a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.595739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c4b70-3ea2-4f18-902f-84add02f4a3c None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.596391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c4b70-3ea2-4f18-902f-84add02f4a3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:43.596695 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c4b70-3ea2-4f18-902f-84add02f4a3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:43.598079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c4b70-3ea2-4f18-902f-84add02f4a3c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:43.606900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 38/80] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:43.607673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c4b70-3ea2-4f18-902f-84add02f4a3c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.641723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd1c9f-880d-4889-bae8-040ad21251d0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.678330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32454a2e-b515-4f31-905d-16671cc932d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.679264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32454a2e-b515-4f31-905d-16671cc932d4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.679719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32454a2e-b515-4f31-905d-16671cc932d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.680162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32454a2e-b515-4f31-905d-16671cc932d4 None admin] PATH_INFO: `/v3/users/06e92989261641b38e78bcbed08924de` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.681776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32454a2e-b515-4f31-905d-16671cc932d4 None admin] RBAC: Authorizing `identity:get_user(user_id=06e92989261641b38e78bcbed08924de)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:43.684084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32454a2e-b515-4f31-905d-16671cc932d4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:43.685948 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 43/81] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/users/06e92989261641b38e78bcbed08924de => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:43.686700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32454a2e-b515-4f31-905d-16671cc932d4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.713023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c4b70-3ea2-4f18-902f-84add02f4a3c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.746533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64512-fa3a-490e-a10b-ab188b160fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.747139 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64512-fa3a-490e-a10b-ab188b160fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.747425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64512-fa3a-490e-a10b-ab188b160fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.747705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64512-fa3a-490e-a10b-ab188b160fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.766229 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:43.781975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:43.790823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32454a2e-b515-4f31-905d-16671cc932d4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.815971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d64512-fa3a-490e-a10b-ab188b160fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:43.817409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d64512-fa3a-490e-a10b-ab188b160fe8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:43.822552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ac1bd-9be1-4bbe-afea-cb65df8d5b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.823175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ac1bd-9be1-4bbe-afea-cb65df8d5b12 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.823957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ac1bd-9be1-4bbe-afea-cb65df8d5b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.824225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ac1bd-9be1-4bbe-afea-cb65df8d5b12 None admin] PATH_INFO: `/v3/users/06e92989261641b38e78bcbed08924de` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.825365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ac1bd-9be1-4bbe-afea-cb65df8d5b12 None admin] RBAC: Authorizing `identity:get_user(user_id=06e92989261641b38e78bcbed08924de)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:43.826808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ac1bd-9be1-4bbe-afea-cb65df8d5b12 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:43.828358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 44/82] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/users/06e92989261641b38e78bcbed08924de => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:43.832962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ac1bd-9be1-4bbe-afea-cb65df8d5b12 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.919459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 39/83] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:18:43.920309 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64512-fa3a-490e-a10b-ab188b160fe8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:43.936421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ac1bd-9be1-4bbe-afea-cb65df8d5b12 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:43.967973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:43.969612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f9590-8dfc-4d4d-a613-eebdd5051469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:43.970244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f9590-8dfc-4d4d-a613-eebdd5051469 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:43.970522 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f9590-8dfc-4d4d-a613-eebdd5051469 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:43.970795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f9590-8dfc-4d4d-a613-eebdd5051469 None admin] PATH_INFO: `/v3/users/d64b74222381414fa028861d4cb5842c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:43.971992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f9590-8dfc-4d4d-a613-eebdd5051469 None admin] RBAC: Authorizing `identity:get_user(user_id=d64b74222381414fa028861d4cb5842c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:43.973484 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f9590-8dfc-4d4d-a613-eebdd5051469 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:43.975076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 45/84] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/users/d64b74222381414fa028861d4cb5842c => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:43.975830 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f9590-8dfc-4d4d-a613-eebdd5051469 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:44.003098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:44.017853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64512-fa3a-490e-a10b-ab188b160fe8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:44.050506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c828-9007-4c80-a91e-e67f32aaa14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:44.051108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c828-9007-4c80-a91e-e67f32aaa14f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:44.051378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c828-9007-4c80-a91e-e67f32aaa14f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:44.051650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c828-9007-4c80-a91e-e67f32aaa14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:44.074847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f9590-8dfc-4d4d-a613-eebdd5051469 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:44.106820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df0ea-8697-409e-a464-2997d55dd903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:44.107456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df0ea-8697-409e-a464-2997d55dd903 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:44.107738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df0ea-8697-409e-a464-2997d55dd903 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:44.108011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df0ea-8697-409e-a464-2997d55dd903 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:44.109134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631df0ea-8697-409e-a464-2997d55dd903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:44.110580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631df0ea-8697-409e-a464-2997d55dd903 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:44.112107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 46/85] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:44.112864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df0ea-8697-409e-a464-2997d55dd903 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:44.121142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575c828-9007-4c80-a91e-e67f32aaa14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:44.122590 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575c828-9007-4c80-a91e-e67f32aaa14f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:44.169702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:44.205818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:44.212065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df0ea-8697-409e-a464-2997d55dd903 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:44.221842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 40/86] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:18:44.222666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c828-9007-4c80-a91e-e67f32aaa14f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:44.248890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e205d6-2fa8-4083-a19f-ea3fc88679dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:44.249525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e205d6-2fa8-4083-a19f-ea3fc88679dd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:44.249811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e205d6-2fa8-4083-a19f-ea3fc88679dd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:44.250084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e205d6-2fa8-4083-a19f-ea3fc88679dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:44.315637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e205d6-2fa8-4083-a19f-ea3fc88679dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:44.317136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e205d6-2fa8-4083-a19f-ea3fc88679dd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:44.318771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c828-9007-4c80-a91e-e67f32aaa14f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:44.352915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06ac0-4686-4ccb-929f-edb6a55ff286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:44.353579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06ac0-4686-4ccb-929f-edb6a55ff286 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:44.353858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06ac0-4686-4ccb-929f-edb6a55ff286 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:44.354135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06ac0-4686-4ccb-929f-edb6a55ff286 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:44.355352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e06ac0-4686-4ccb-929f-edb6a55ff286 None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:44.356783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e06ac0-4686-4ccb-929f-edb6a55ff286 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:44.358468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 41/87] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:44 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:44.359229 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06ac0-4686-4ccb-929f-edb6a55ff286 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:44.379284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:44.416646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:44.423435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 47/88] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:18:44.424030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e205d6-2fa8-4083-a19f-ea3fc88679dd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:44.462064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06ac0-4686-4ccb-929f-edb6a55ff286 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:44.494619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165475a-c641-4a6b-aa6c-eb076d0dea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:44.495241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165475a-c641-4a6b-aa6c-eb076d0dea12 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:44.495524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165475a-c641-4a6b-aa6c-eb076d0dea12 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:44.495806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165475a-c641-4a6b-aa6c-eb076d0dea12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:44.517837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e205d6-2fa8-4083-a19f-ea3fc88679dd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:44.551066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160429c4-721d-499f-b0fe-39082793742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:44.551691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160429c4-721d-499f-b0fe-39082793742e None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:44.551975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160429c4-721d-499f-b0fe-39082793742e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:44.552254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160429c4-721d-499f-b0fe-39082793742e None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:44.552896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160429c4-721d-499f-b0fe-39082793742e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:44.554382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160429c4-721d-499f-b0fe-39082793742e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:44.561042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165475a-c641-4a6b-aa6c-eb076d0dea12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:44.562488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165475a-c641-4a6b-aa6c-eb076d0dea12 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:44.575872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 48/89] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:18:44 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:18:44.576681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160429c4-721d-499f-b0fe-39082793742e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:44.593414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:44.638199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:44.689502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160429c4-721d-499f-b0fe-39082793742e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:44.691122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 42/90] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:18:44.696136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165475a-c641-4a6b-aa6c-eb076d0dea12 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:44.733148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ff9d6-0b9e-4c1b-a02d-cd154c9d6e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:44.733786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ff9d6-0b9e-4c1b-a02d-cd154c9d6e0f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:44.734067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ff9d6-0b9e-4c1b-a02d-cd154c9d6e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:44.734351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ff9d6-0b9e-4c1b-a02d-cd154c9d6e0f None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:44.735662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ff9d6-0b9e-4c1b-a02d-cd154c9d6e0f None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:44.737165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ff9d6-0b9e-4c1b-a02d-cd154c9d6e0f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:44.743845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 49/91] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:44 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:44.743845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ff9d6-0b9e-4c1b-a02d-cd154c9d6e0f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:44.817280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165475a-c641-4a6b-aa6c-eb076d0dea12 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:44.838749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:44.864129 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8044e-dcf8-4d64-886a-1e155b4b1069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:44.865349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8044e-dcf8-4d64-886a-1e155b4b1069 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:44.865349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8044e-dcf8-4d64-886a-1e155b4b1069 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:44.865349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8044e-dcf8-4d64-886a-1e155b4b1069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:44.866378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8044e-dcf8-4d64-886a-1e155b4b1069 None admin] RBAC: Adding query filter params (role.id=d598e7097e2d496f971598b09965388a, scope.project.id=353afc27991d4d4bbe4860b6b70da681, user.id=06e92989261641b38e78bcbed08924de) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:44.866496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8044e-dcf8-4d64-886a-1e155b4b1069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:44.867852 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8044e-dcf8-4d64-886a-1e155b4b1069 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:44.869680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ff9d6-0b9e-4c1b-a02d-cd154c9d6e0f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:44.878448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 43/92] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:18:44 2022] GET /identity/v3/role_assignments?user.id=06e92989261641b38e78bcbed08924de&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=d598e7097e2d496f971598b09965388a => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:44.879192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8044e-dcf8-4d64-886a-1e155b4b1069 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:44.898155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:44.919296 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2b92-7626-41ad-9deb-b22952b1ed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:44.920115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2b92-7626-41ad-9deb-b22952b1ed52 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:44.920532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2b92-7626-41ad-9deb-b22952b1ed52 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:44.920883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2b92-7626-41ad-9deb-b22952b1ed52 None admin] PATH_INFO: `/v3/projects/8d8496d348304de38eee83bd9624d7eb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:44.922230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f2b92-7626-41ad-9deb-b22952b1ed52 None admin] RBAC: Authorizing `identity:get_project(project_id=8d8496d348304de38eee83bd9624d7eb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:44.923757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f2b92-7626-41ad-9deb-b22952b1ed52 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:44.925716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 50/93] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:44 2022] GET /identity/v3/projects/8d8496d348304de38eee83bd9624d7eb => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:44.926365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2b92-7626-41ad-9deb-b22952b1ed52 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:45.011831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8044e-dcf8-4d64-886a-1e155b4b1069 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:45.060490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9dc70-31fb-481c-b98a-5ea910750659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:45.061195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9dc70-31fb-481c-b98a-5ea910750659 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:45.061488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9dc70-31fb-481c-b98a-5ea910750659 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:45.061771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9dc70-31fb-481c-b98a-5ea910750659 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:45.063206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9dc70-31fb-481c-b98a-5ea910750659 None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:45.065520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9dc70-31fb-481c-b98a-5ea910750659 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:45.068206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 44/94] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:44 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:45.069683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9dc70-31fb-481c-b98a-5ea910750659 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:45.072105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2b92-7626-41ad-9deb-b22952b1ed52 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:45.127275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c0447-beb1-4970-8a2e-0cd7aea4df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:45.127907 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c0447-beb1-4970-8a2e-0cd7aea4df8e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:45.128193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c0447-beb1-4970-8a2e-0cd7aea4df8e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:45.128479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c0447-beb1-4970-8a2e-0cd7aea4df8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:45.129791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c0447-beb1-4970-8a2e-0cd7aea4df8e None admin] RBAC: Adding query filter params (role.id=d742575a6b40459fbb329defa3b642c5, scope.project.id=353afc27991d4d4bbe4860b6b70da681, user.id=06e92989261641b38e78bcbed08924de) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:45.130114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c0447-beb1-4970-8a2e-0cd7aea4df8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:45.132029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c0447-beb1-4970-8a2e-0cd7aea4df8e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:45.138854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:45.141148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 51/95] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:18:44 2022] GET /identity/v3/role_assignments?user.id=06e92989261641b38e78bcbed08924de&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=d742575a6b40459fbb329defa3b642c5 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:45.145564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c0447-beb1-4970-8a2e-0cd7aea4df8e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:45.270543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:45.273922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9dc70-31fb-481c-b98a-5ea910750659 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:45.366049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2ae6b-4555-40ed-8e78-9c62085dbdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:45.367514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ae6b-4555-40ed-8e78-9c62085dbdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:45.367996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ae6b-4555-40ed-8e78-9c62085dbdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:45.368466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2ae6b-4555-40ed-8e78-9c62085dbdd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:45.369428 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2ae6b-4555-40ed-8e78-9c62085dbdd1 None admin] RBAC: Adding query filter params (role.id=d598e7097e2d496f971598b09965388a, scope.project.id=8d8496d348304de38eee83bd9624d7eb, user.id=06e92989261641b38e78bcbed08924de) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:45.370678 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2ae6b-4555-40ed-8e78-9c62085dbdd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:45.372501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2ae6b-4555-40ed-8e78-9c62085dbdd1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:45.391960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 45/96] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:18:45 2022] GET /identity/v3/role_assignments?user.id=06e92989261641b38e78bcbed08924de&scope.project.id=8d8496d348304de38eee83bd9624d7eb&role.id=d598e7097e2d496f971598b09965388a => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:45.399927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c0447-beb1-4970-8a2e-0cd7aea4df8e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:45.445644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e27d25-4552-4a79-aeb6-2dbfb8dcc8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:45.446611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27d25-4552-4a79-aeb6-2dbfb8dcc8ef None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:45.447252 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27d25-4552-4a79-aeb6-2dbfb8dcc8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:45.447742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e27d25-4552-4a79-aeb6-2dbfb8dcc8ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:45.448820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e27d25-4552-4a79-aeb6-2dbfb8dcc8ef None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=353afc27991d4d4bbe4860b6b70da681, user.id=d64b74222381414fa028861d4cb5842c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:45.449353 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e27d25-4552-4a79-aeb6-2dbfb8dcc8ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:45.451016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e27d25-4552-4a79-aeb6-2dbfb8dcc8ef None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:45.461772 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 52/97] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:18:45 2022] GET /identity/v3/role_assignments?user.id=d64b74222381414fa028861d4cb5842c&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:47.535333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a37a7f-61ee-4919-abd5-8215dcda04fa None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:47.535834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a37a7f-61ee-4919-abd5-8215dcda04fa None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:47.535905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a37a7f-61ee-4919-abd5-8215dcda04fa None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:47.537396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 46/98] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:47.543134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547d06a-a99a-4bd7-a06d-5c293e979cc6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:47.543543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547d06a-a99a-4bd7-a06d-5c293e979cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:47.543707 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547d06a-a99a-4bd7-a06d-5c293e979cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:47.569953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3547d06a-a99a-4bd7-a06d-5c293e979cc6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:47.571153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3547d06a-a99a-4bd7-a06d-5c293e979cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:47.573995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667eb14-c63d-42d5-b408-31c73f24e6d7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:47.574282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667eb14-c63d-42d5-b408-31c73f24e6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:47.574563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667eb14-c63d-42d5-b408-31c73f24e6d7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:47.575900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 47/99] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:47.580880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1d621-6867-4ba0-9837-81777d660f1e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:47.581195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1d621-6867-4ba0-9837-81777d660f1e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:47.581476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1d621-6867-4ba0-9837-81777d660f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:47.606919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9ca1d621-6867-4ba0-9837-81777d660f1e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:47.608115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9ca1d621-6867-4ba0-9837-81777d660f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:47.717176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 53/100] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:47.720000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bc8e9-0204-423b-9aa3-d249fa78821d None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:47.720506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bc8e9-0204-423b-9aa3-d249fa78821d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:47.721711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bc8e9-0204-423b-9aa3-d249fa78821d None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:47.723838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 54/101] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:47.730279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901d60f-6b5d-4780-865d-662b4283b624 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:47.731046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901d60f-6b5d-4780-865d-662b4283b624 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:47.732223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901d60f-6b5d-4780-865d-662b4283b624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:47.741126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 48/102] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:18:47.755498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5901d60f-6b5d-4780-865d-662b4283b624 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:47.756994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5901d60f-6b5d-4780-865d-662b4283b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:47.806214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:47.832878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 55/103] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:18:48.067479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1d621-6867-4ba0-9837-81777d660f1e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:48.129010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:48.166416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901d60f-6b5d-4780-865d-662b4283b624 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:48.206429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1d621-6867-4ba0-9837-81777d660f1e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:48.251713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abc4e9-34a0-434c-bd2c-695ea6ebc69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:48.252712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc4e9-34a0-434c-bd2c-695ea6ebc69f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:48.254319 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc4e9-34a0-434c-bd2c-695ea6ebc69f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:48.254966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc4e9-34a0-434c-bd2c-695ea6ebc69f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:48.277560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abc4e9-34a0-434c-bd2c-695ea6ebc69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-20abc4e9-34a0-434c-bd2c-695ea6ebc69f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:48.283788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:48.284623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:18:48.285417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:48.288572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 49/104] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:48.294068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abc4e9-34a0-434c-bd2c-695ea6ebc69f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:48.339853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901d60f-6b5d-4780-865d-662b4283b624 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:48.394225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9cae1-d7ee-4866-813f-9c084c5922b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:48.394873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9cae1-d7ee-4866-813f-9c084c5922b3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:48.395157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9cae1-d7ee-4866-813f-9c084c5922b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:48.395433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9cae1-d7ee-4866-813f-9c084c5922b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:48.397261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9cae1-d7ee-4866-813f-9c084c5922b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:48.398714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9cae1-d7ee-4866-813f-9c084c5922b3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:48.400722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 56/105] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:48.405356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9cae1-d7ee-4866-813f-9c084c5922b3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:48.469438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:48.537033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9cae1-d7ee-4866-813f-9c084c5922b3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:48.562942 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abc4e9-34a0-434c-bd2c-695ea6ebc69f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:48.565668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:48.579590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995ae0-ea2f-47bd-9ddc-10d4554f10e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:48.580213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995ae0-ea2f-47bd-9ddc-10d4554f10e8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:48.580493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995ae0-ea2f-47bd-9ddc-10d4554f10e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:48.580773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995ae0-ea2f-47bd-9ddc-10d4554f10e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:48.581479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b995ae0-ea2f-47bd-9ddc-10d4554f10e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:48.581792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b995ae0-ea2f-47bd-9ddc-10d4554f10e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:48.583389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b995ae0-ea2f-47bd-9ddc-10d4554f10e8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:48.601771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 57/106] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:18:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:48.602364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995ae0-ea2f-47bd-9ddc-10d4554f10e8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:48.631585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aa38e-4837-452f-b659-cf36a8ddb487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:48.632237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa38e-4837-452f-b659-cf36a8ddb487 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:48.632522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa38e-4837-452f-b659-cf36a8ddb487 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:48.632834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa38e-4837-452f-b659-cf36a8ddb487 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:48.647941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006aa38e-4837-452f-b659-cf36a8ddb487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-006aa38e-4837-452f-b659-cf36a8ddb487 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:48.653221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:48.654045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:48.654784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 50/107] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:48.655413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aa38e-4837-452f-b659-cf36a8ddb487 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:48.731657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995ae0-ea2f-47bd-9ddc-10d4554f10e8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:48.740237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:48.763912 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aa38e-4837-452f-b659-cf36a8ddb487 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:48.772374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0aebc-f93a-42ae-aafd-1428996e7782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:48.773260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0aebc-f93a-42ae-aafd-1428996e7782 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:48.773683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0aebc-f93a-42ae-aafd-1428996e7782 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:48.774096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0aebc-f93a-42ae-aafd-1428996e7782 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:48.774988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0aebc-f93a-42ae-aafd-1428996e7782 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:48.777176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0aebc-f93a-42ae-aafd-1428996e7782 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:48.804258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3333d-09c2-4143-b490-df3b375f9797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:48.805088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3333d-09c2-4143-b490-df3b375f9797 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:48.805514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3333d-09c2-4143-b490-df3b375f9797 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:48.805885 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3333d-09c2-4143-b490-df3b375f9797 None admin] PATH_INFO: `/v3/users/701188430312493b99fa6229ae7630ad` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:48.813674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 58/108] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:18:48 2022] POST /identity/v3/projects => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:18:48.815390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14866909-fc0a-4fc0-a1fa-215e86a8c330 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:48.815886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14866909-fc0a-4fc0-a1fa-215e86a8c330 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:48.816434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14866909-fc0a-4fc0-a1fa-215e86a8c330 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:48.822821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 59/109] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:48.824802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3333d-09c2-4143-b490-df3b375f9797 None admin] RBAC: Authorizing `identity:get_user(user_id=701188430312493b99fa6229ae7630ad)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:48.825227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14866909-fc0a-4fc0-a1fa-215e86a8c330 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:48.826469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3333d-09c2-4143-b490-df3b375f9797 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:48.828476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 51/110] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:48 2022] GET /identity/v3/users/701188430312493b99fa6229ae7630ad => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:48.829630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9122b-1207-4810-be8b-4db42d93227f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:48.829976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9122b-1207-4810-be8b-4db42d93227f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:48.830298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9122b-1207-4810-be8b-4db42d93227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:48.851206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c4d9122b-1207-4810-be8b-4db42d93227f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:48.852750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c4d9122b-1207-4810-be8b-4db42d93227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:48.874574 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:48.936789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 52/111] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:48.937594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9122b-1207-4810-be8b-4db42d93227f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:48.961735 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14866909-fc0a-4fc0-a1fa-215e86a8c330 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:49.013285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994e430-ecd0-4da8-8f98-e5f30eb5fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:49.014302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994e430-ecd0-4da8-8f98-e5f30eb5fef8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.014777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994e430-ecd0-4da8-8f98-e5f30eb5fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.015244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994e430-ecd0-4da8-8f98-e5f30eb5fef8 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.016112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994e430-ecd0-4da8-8f98-e5f30eb5fef8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:49.016606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994e430-ecd0-4da8-8f98-e5f30eb5fef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:49.018224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994e430-ecd0-4da8-8f98-e5f30eb5fef8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:49.027774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 60/112] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:18:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:49.029362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6c08-7180-40d8-a7ed-5cd5dcf32f78 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.029846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6c08-7180-40d8-a7ed-5cd5dcf32f78 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.030310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6c08-7180-40d8-a7ed-5cd5dcf32f78 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.031801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 61/113] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:49.033511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6c08-7180-40d8-a7ed-5cd5dcf32f78 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:49.057282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9122b-1207-4810-be8b-4db42d93227f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:49.062358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:49.129853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bce32-2033-4101-9c06-c90b6077cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:49.130457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bce32-2033-4101-9c06-c90b6077cfbd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.130746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bce32-2033-4101-9c06-c90b6077cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.131778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bce32-2033-4101-9c06-c90b6077cfbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.165415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:49.166021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6c08-7180-40d8-a7ed-5cd5dcf32f78 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:49.203620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5418c-ff44-4d5b-b5da-91c32c66b59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:49.204577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5418c-ff44-4d5b-b5da-91c32c66b59a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.205084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5418c-ff44-4d5b-b5da-91c32c66b59a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.205576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5418c-ff44-4d5b-b5da-91c32c66b59a None admin] PATH_INFO: `/v3/users/06e92989261641b38e78bcbed08924de` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.206917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5418c-ff44-4d5b-b5da-91c32c66b59a None admin] RBAC: Authorizing `identity:get_user(user_id=06e92989261641b38e78bcbed08924de)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:49.208554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5418c-ff44-4d5b-b5da-91c32c66b59a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:49.210383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 62/114] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:49 2022] GET /identity/v3/users/06e92989261641b38e78bcbed08924de => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:49.211778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663334-9f05-4a74-b593-08f48ccbe127 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.212258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663334-9f05-4a74-b593-08f48ccbe127 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.212720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663334-9f05-4a74-b593-08f48ccbe127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.217443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bce32-2033-4101-9c06-c90b6077cfbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:49.221008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bce32-2033-4101-9c06-c90b6077cfbd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:49.242376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-61663334-9f05-4a74-b593-08f48ccbe127 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:49.243892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-61663334-9f05-4a74-b593-08f48ccbe127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:49.322770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 63/115] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:49.323919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663334-9f05-4a74-b593-08f48ccbe127 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:49.340414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 53/116] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:18:49.345622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:49.347274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a921e3d-2b22-4d3e-b4a6-1de57de8ebcf None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.347568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a921e3d-2b22-4d3e-b4a6-1de57de8ebcf None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.347846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a921e3d-2b22-4d3e-b4a6-1de57de8ebcf None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.349358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 54/117] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:49.355279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a921e3d-2b22-4d3e-b4a6-1de57de8ebcf None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:49.421449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:49.459333 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663334-9f05-4a74-b593-08f48ccbe127 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:49.474676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a921e3d-2b22-4d3e-b4a6-1de57de8ebcf None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:49.505239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb3b71-f83c-434a-9d28-a2e40d6ebc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:49.506274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3b71-f83c-434a-9d28-a2e40d6ebc36 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.506763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3b71-f83c-434a-9d28-a2e40d6ebc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.507234 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3b71-f83c-434a-9d28-a2e40d6ebc36 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.508485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb3b71-f83c-434a-9d28-a2e40d6ebc36 None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:49.510111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb3b71-f83c-434a-9d28-a2e40d6ebc36 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:49.511592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2e908-f5a6-40ae-b2ec-94359553cb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:49.512345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2e908-f5a6-40ae-b2ec-94359553cb6b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.512498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 64/118] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:49 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:49.513400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb3b71-f83c-434a-9d28-a2e40d6ebc36 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:49.517618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2e908-f5a6-40ae-b2ec-94359553cb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.517618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2e908-f5a6-40ae-b2ec-94359553cb6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.530116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2e908-f5a6-40ae-b2ec-94359553cb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b3e2e908-f5a6-40ae-b2ec-94359553cb6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:49.535663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:49.536682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:49.537460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 55/119] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:49.538143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671198a-aa43-4b11-901f-86c05b41b3dc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.538438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671198a-aa43-4b11-901f-86c05b41b3dc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.538717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671198a-aa43-4b11-901f-86c05b41b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.560789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c671198a-aa43-4b11-901f-86c05b41b3dc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:49.562051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c671198a-aa43-4b11-901f-86c05b41b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:49.609320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:49.627959 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb3b71-f83c-434a-9d28-a2e40d6ebc36 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:49.638196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 56/120] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:49.642106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671198a-aa43-4b11-901f-86c05b41b3dc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:49.663522 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bee532-b2cb-4a38-a643-27d57f4cfb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:49.664168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bee532-b2cb-4a38-a643-27d57f4cfb82 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.664451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bee532-b2cb-4a38-a643-27d57f4cfb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.664727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bee532-b2cb-4a38-a643-27d57f4cfb82 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.665932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bee532-b2cb-4a38-a643-27d57f4cfb82 None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:49.667950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bee532-b2cb-4a38-a643-27d57f4cfb82 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:49.669656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 65/121] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:49 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:49.674543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bee532-b2cb-4a38-a643-27d57f4cfb82 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:49.721017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:49.781893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bee532-b2cb-4a38-a643-27d57f4cfb82 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:49.800161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671198a-aa43-4b11-901f-86c05b41b3dc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:49.818318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724008e-328b-4f07-b5ad-2e14f4906984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:49.819057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724008e-328b-4f07-b5ad-2e14f4906984 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.819670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724008e-328b-4f07-b5ad-2e14f4906984 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.819670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724008e-328b-4f07-b5ad-2e14f4906984 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.820437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724008e-328b-4f07-b5ad-2e14f4906984 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:49.820884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724008e-328b-4f07-b5ad-2e14f4906984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:49.822285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724008e-328b-4f07-b5ad-2e14f4906984 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:49.836005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 66/122] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:18:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:49.837201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724008e-328b-4f07-b5ad-2e14f4906984 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:49.847142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3b96-a9f6-416a-a498-1b9ad66f3c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:49.847866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3b96-a9f6-416a-a498-1b9ad66f3c30 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:49.848505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3b96-a9f6-416a-a498-1b9ad66f3c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:49.848505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3b96-a9f6-416a-a498-1b9ad66f3c30 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681/users/06e92989261641b38e78bcbed08924de/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:49.850382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee3b96-a9f6-416a-a498-1b9ad66f3c30 None admin] RBAC: Authorizing `identity:create_grant(project_id=353afc27991d4d4bbe4860b6b70da681, user_id=06e92989261641b38e78bcbed08924de, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:49.851816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee3b96-a9f6-416a-a498-1b9ad66f3c30 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:49.860381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:49.867987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 57/123] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:18:49 2022] PUT /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681/users/06e92989261641b38e78bcbed08924de/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:18:49.869142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3b96-a9f6-416a-a498-1b9ad66f3c30 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:49.966113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724008e-328b-4f07-b5ad-2e14f4906984 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:49.999322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3b96-a9f6-416a-a498-1b9ad66f3c30 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:50.001422 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:50.008092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6f08-193c-4bf2-890b-653429c1c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:50.010737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6f08-193c-4bf2-890b-653429c1c237 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:50.011302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6f08-193c-4bf2-890b-653429c1c237 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:50.011730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6f08-193c-4bf2-890b-653429c1c237 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:50.030042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6f08-193c-4bf2-890b-653429c1c237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e7bb6f08-193c-4bf2-890b-653429c1c237 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:50.039737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:50.040839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:18:50.041911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 67/124] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:18:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:50.042659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6f08-193c-4bf2-890b-653429c1c237 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:50.057170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75440-e661-47d8-8134-3444050cb0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:50.058336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75440-e661-47d8-8134-3444050cb0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:50.059115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75440-e661-47d8-8134-3444050cb0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:50.059415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75440-e661-47d8-8134-3444050cb0d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:50.060175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75440-e661-47d8-8134-3444050cb0d6 None admin] RBAC: Adding query filter params (role.id=0f69d1c2776d4f3c912de690451a4697, scope.project.id=353afc27991d4d4bbe4860b6b70da681, user.id=701188430312493b99fa6229ae7630ad) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:50.060490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75440-e661-47d8-8134-3444050cb0d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:50.062783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75440-e661-47d8-8134-3444050cb0d6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:50.070218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 58/125] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:18:49 2022] GET /identity/v3/role_assignments?user.id=701188430312493b99fa6229ae7630ad&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=0f69d1c2776d4f3c912de690451a4697 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:50.071096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75440-e661-47d8-8134-3444050cb0d6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:50.161339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:50.188148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6f08-193c-4bf2-890b-653429c1c237 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:50.222162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75440-e661-47d8-8134-3444050cb0d6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:50.231590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ddc34-cfb4-4e6a-8198-6d59eef2a59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:50.232358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ddc34-cfb4-4e6a-8198-6d59eef2a59a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:50.232658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ddc34-cfb4-4e6a-8198-6d59eef2a59a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:50.232940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ddc34-cfb4-4e6a-8198-6d59eef2a59a None admin] PATH_INFO: `/v3/users/06e92989261641b38e78bcbed08924de` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:50.234387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ddc34-cfb4-4e6a-8198-6d59eef2a59a None admin] RBAC: Authorizing `identity:get_user(user_id=06e92989261641b38e78bcbed08924de)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:50.236588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ddc34-cfb4-4e6a-8198-6d59eef2a59a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:50.238777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 68/126] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:50 2022] GET /identity/v3/users/06e92989261641b38e78bcbed08924de => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:50.239406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ddc34-cfb4-4e6a-8198-6d59eef2a59a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:50.263082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045111d-8687-459d-a852-791be0863fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:50.263781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045111d-8687-459d-a852-791be0863fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:50.264074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045111d-8687-459d-a852-791be0863fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:50.264352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045111d-8687-459d-a852-791be0863fe8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:50.277976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045111d-8687-459d-a852-791be0863fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-9045111d-8687-459d-a852-791be0863fe8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:50.283605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:50.284659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:50.285652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:50.289027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 59/127] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:50.289987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045111d-8687-459d-a852-791be0863fe8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:50.318685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:50.438599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045111d-8687-459d-a852-791be0863fe8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:50.457285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ddc34-cfb4-4e6a-8198-6d59eef2a59a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:50.507881 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b159b-21f9-4ba4-9ab1-8c6a3fd63a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:50.508440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b159b-21f9-4ba4-9ab1-8c6a3fd63a94 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:50.508722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b159b-21f9-4ba4-9ab1-8c6a3fd63a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:50.509019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b159b-21f9-4ba4-9ab1-8c6a3fd63a94 None admin] PATH_INFO: `/v3/projects/8d8496d348304de38eee83bd9624d7eb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:50.512311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b159b-21f9-4ba4-9ab1-8c6a3fd63a94 None admin] RBAC: Authorizing `identity:get_project(project_id=8d8496d348304de38eee83bd9624d7eb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:50.513775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b159b-21f9-4ba4-9ab1-8c6a3fd63a94 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:50.520113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 60/128] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:50 2022] GET /identity/v3/projects/8d8496d348304de38eee83bd9624d7eb => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:50.521351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b159b-21f9-4ba4-9ab1-8c6a3fd63a94 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:50.527605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060e6e4-d1fd-4bd0-b303-7cbefb198284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:50.528217 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060e6e4-d1fd-4bd0-b303-7cbefb198284 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:50.528500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060e6e4-d1fd-4bd0-b303-7cbefb198284 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:50.528773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060e6e4-d1fd-4bd0-b303-7cbefb198284 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:50.529471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060e6e4-d1fd-4bd0-b303-7cbefb198284 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:50.529776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060e6e4-d1fd-4bd0-b303-7cbefb198284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:50.536561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060e6e4-d1fd-4bd0-b303-7cbefb198284 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:50.551424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 69/129] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:18:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:50.552243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060e6e4-d1fd-4bd0-b303-7cbefb198284 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:50.573313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:50.677639 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:50.680714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b159b-21f9-4ba4-9ab1-8c6a3fd63a94 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:50.717059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ad974-713a-48ce-a94b-85fb581df3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:50.718044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ad974-713a-48ce-a94b-85fb581df3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:50.718533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ad974-713a-48ce-a94b-85fb581df3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:50.719008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ad974-713a-48ce-a94b-85fb581df3c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:50.719874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ad974-713a-48ce-a94b-85fb581df3c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:50.720381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ad974-713a-48ce-a94b-85fb581df3c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:50.722007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ad974-713a-48ce-a94b-85fb581df3c1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:50.736045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060e6e4-d1fd-4bd0-b303-7cbefb198284 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:50.736775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 61/130] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:50.737875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ad974-713a-48ce-a94b-85fb581df3c1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:50.775725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5d50e-4132-4694-abf4-21450803c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:50.775725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5d50e-4132-4694-abf4-21450803c32f None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:50.775725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5d50e-4132-4694-abf4-21450803c32f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:50.775725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5d50e-4132-4694-abf4-21450803c32f None admin] PATH_INFO: `/v3/projects/8d8496d348304de38eee83bd9624d7eb/users/06e92989261641b38e78bcbed08924de/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:50.776079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5d50e-4132-4694-abf4-21450803c32f None admin] RBAC: Authorizing `identity:create_grant(project_id=8d8496d348304de38eee83bd9624d7eb, user_id=06e92989261641b38e78bcbed08924de, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:50.777939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5d50e-4132-4694-abf4-21450803c32f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:50.808800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 70/131] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:18:50 2022] PUT /identity/v3/projects/8d8496d348304de38eee83bd9624d7eb/users/06e92989261641b38e78bcbed08924de/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:18:50.810586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5d50e-4132-4694-abf4-21450803c32f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:50.928710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ad974-713a-48ce-a94b-85fb581df3c1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:50.947162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:51.008277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e06c1d-d2ae-47af-b864-8fe9d4e8b314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:51.008937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e06c1d-d2ae-47af-b864-8fe9d4e8b314 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:51.009242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e06c1d-d2ae-47af-b864-8fe9d4e8b314 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:51.009516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e06c1d-d2ae-47af-b864-8fe9d4e8b314 None admin] PATH_INFO: `/v3/users/06e92989261641b38e78bcbed08924de` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:51.012455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e06c1d-d2ae-47af-b864-8fe9d4e8b314 None admin] RBAC: Authorizing `identity:get_user(user_id=06e92989261641b38e78bcbed08924de)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:51.015694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e06c1d-d2ae-47af-b864-8fe9d4e8b314 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:51.018667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 62/132] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:50 2022] GET /identity/v3/users/06e92989261641b38e78bcbed08924de => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:51.021621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5d50e-4132-4694-abf4-21450803c32f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:51.024336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e06c1d-d2ae-47af-b864-8fe9d4e8b314 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:51.078096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:51.096150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf9611-bca8-48e3-b516-de70666be420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:51.096878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf9611-bca8-48e3-b516-de70666be420 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:51.097186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf9611-bca8-48e3-b516-de70666be420 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:51.097459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf9611-bca8-48e3-b516-de70666be420 None admin] PATH_INFO: `/v3/users/d64b74222381414fa028861d4cb5842c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:51.103774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf9611-bca8-48e3-b516-de70666be420 None admin] RBAC: Authorizing `identity:get_user(user_id=d64b74222381414fa028861d4cb5842c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:51.105928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf9611-bca8-48e3-b516-de70666be420 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:51.111512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 71/133] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:50 2022] GET /identity/v3/users/d64b74222381414fa028861d4cb5842c => generated 247 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:51.122201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf9611-bca8-48e3-b516-de70666be420 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:51.247395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e06c1d-d2ae-47af-b864-8fe9d4e8b314 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:51.324976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae32642-1810-43be-8af5-e109578bcadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:51.324976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae32642-1810-43be-8af5-e109578bcadd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:51.324976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae32642-1810-43be-8af5-e109578bcadd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:51.324976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae32642-1810-43be-8af5-e109578bcadd None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:51.325421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf9611-bca8-48e3-b516-de70666be420 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:51.326482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae32642-1810-43be-8af5-e109578bcadd None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:51.333040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae32642-1810-43be-8af5-e109578bcadd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:51.335209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 63/134] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:51 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:51.343337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae32642-1810-43be-8af5-e109578bcadd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:51.418136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e818-ce6b-4bfd-b6da-e537c3664e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:51.419042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e818-ce6b-4bfd-b6da-e537c3664e4f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:51.419421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e818-ce6b-4bfd-b6da-e537c3664e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:51.419795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e818-ce6b-4bfd-b6da-e537c3664e4f None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:51.421614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988e818-ce6b-4bfd-b6da-e537c3664e4f None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:51.423171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988e818-ce6b-4bfd-b6da-e537c3664e4f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:51.425173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 72/135] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:51 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:51.431975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e818-ce6b-4bfd-b6da-e537c3664e4f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:51.435258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:51.587322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:51.610513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae32642-1810-43be-8af5-e109578bcadd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:51.669740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e818-ce6b-4bfd-b6da-e537c3664e4f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:51.699519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5006a2b-e44b-41b6-9074-1deaca168071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:51.701222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5006a2b-e44b-41b6-9074-1deaca168071 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:51.701514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5006a2b-e44b-41b6-9074-1deaca168071 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:51.701792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5006a2b-e44b-41b6-9074-1deaca168071 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681/users/06e92989261641b38e78bcbed08924de/roles/d742575a6b40459fbb329defa3b642c5` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:51.707370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5006a2b-e44b-41b6-9074-1deaca168071 None admin] RBAC: Authorizing `identity:create_grant(project_id=353afc27991d4d4bbe4860b6b70da681, user_id=06e92989261641b38e78bcbed08924de, role_id=d742575a6b40459fbb329defa3b642c5)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:51.709722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5006a2b-e44b-41b6-9074-1deaca168071 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:51.749194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 64/136] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:18:51 2022] PUT /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681/users/06e92989261641b38e78bcbed08924de/roles/d742575a6b40459fbb329defa3b642c5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:18:51.758519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5e80-7644-4518-b2b0-12855715dede None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:51.759316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5e80-7644-4518-b2b0-12855715dede None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:51.759848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5e80-7644-4518-b2b0-12855715dede None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:51.763318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 65/137] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:51 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:51.786295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e7244-8cfc-49b3-83c2-1f075acb7765 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:51.786585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e7244-8cfc-49b3-83c2-1f075acb7765 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:51.788472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e7244-8cfc-49b3-83c2-1f075acb7765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:51.788576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe2ff-7a15-4ae5-846e-f496ee14ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:51.793482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe2ff-7a15-4ae5-846e-f496ee14ca39 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:51.793956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe2ff-7a15-4ae5-846e-f496ee14ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:51.799241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe2ff-7a15-4ae5-846e-f496ee14ca39 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681/users/d64b74222381414fa028861d4cb5842c/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:51.815458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffe2ff-7a15-4ae5-846e-f496ee14ca39 None admin] RBAC: Authorizing `identity:create_grant(project_id=353afc27991d4d4bbe4860b6b70da681, user_id=d64b74222381414fa028861d4cb5842c, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:51.816932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffe2ff-7a15-4ae5-846e-f496ee14ca39 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:51.835636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1e9e7244-8cfc-49b3-83c2-1f075acb7765 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:51.838931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1e9e7244-8cfc-49b3-83c2-1f075acb7765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:51.855753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 73/138] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:18:51 2022] PUT /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681/users/d64b74222381414fa028861d4cb5842c/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:18:51.986438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 66/139] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 26 10:18:52.355026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe2ff-7a15-4ae5-846e-f496ee14ca39 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:52.441614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:52.498275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe2ff-7a15-4ae5-846e-f496ee14ca39 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:52.549386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332590a5-4c27-4307-a222-7eef7b49bc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:52.550032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332590a5-4c27-4307-a222-7eef7b49bc27 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:52.550315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332590a5-4c27-4307-a222-7eef7b49bc27 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:52.550585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332590a5-4c27-4307-a222-7eef7b49bc27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:52.553655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332590a5-4c27-4307-a222-7eef7b49bc27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:52.555109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332590a5-4c27-4307-a222-7eef7b49bc27 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:52.556704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 74/140] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:52.562253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e7244-8cfc-49b3-83c2-1f075acb7765 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:52.696097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:52.721176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e7244-8cfc-49b3-83c2-1f075acb7765 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:52.763549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52792aef-37c0-406a-8e1c-ceee29341fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:52.764559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52792aef-37c0-406a-8e1c-ceee29341fd4 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:52.765063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52792aef-37c0-406a-8e1c-ceee29341fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:52.765530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52792aef-37c0-406a-8e1c-ceee29341fd4 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:52.766407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52792aef-37c0-406a-8e1c-ceee29341fd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:52.768015 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52792aef-37c0-406a-8e1c-ceee29341fd4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:52.774668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e614ba5-1428-47c4-9ab7-7c49ea98060a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:52.774964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e614ba5-1428-47c4-9ab7-7c49ea98060a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:52.775245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e614ba5-1428-47c4-9ab7-7c49ea98060a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:52.777446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 75/141] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:52.794629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfff05-3148-4a65-9726-55486acfa9c6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:52.795243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfff05-3148-4a65-9726-55486acfa9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:52.795243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfff05-3148-4a65-9726-55486acfa9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:52.825174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 67/142] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:18:52 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:18:52.826385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-08dfff05-3148-4a65-9726-55486acfa9c6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:52.827659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-08dfff05-3148-4a65-9726-55486acfa9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:52.938861 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 76/143] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:18:53.351054 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4aee5-f86b-4d0b-9ad0-9c468da9a085 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:53.351708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4aee5-f86b-4d0b-9ad0-9c468da9a085 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:53.352192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4aee5-f86b-4d0b-9ad0-9c468da9a085 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:53.353870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 68/144] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:53.359910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139589a-bb74-43c6-b090-a76c2187d592 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:53.360485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139589a-bb74-43c6-b090-a76c2187d592 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:53.360969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139589a-bb74-43c6-b090-a76c2187d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:53.391313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a139589a-bb74-43c6-b090-a76c2187d592 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:53.392498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a139589a-bb74-43c6-b090-a76c2187d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:53.462297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:53.478275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 77/145] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:53.554411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4aee5-f86b-4d0b-9ad0-9c468da9a085 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:53.676525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4aee5-f86b-4d0b-9ad0-9c468da9a085 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:53.721052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e4d6f-04a4-44d2-bf38-d3ae7b4afb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:53.721688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e4d6f-04a4-44d2-bf38-d3ae7b4afb81 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:53.722197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e4d6f-04a4-44d2-bf38-d3ae7b4afb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:53.722272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e4d6f-04a4-44d2-bf38-d3ae7b4afb81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:53.731784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:53.735461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e4d6f-04a4-44d2-bf38-d3ae7b4afb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6d5e4d6f-04a4-44d2-bf38-d3ae7b4afb81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:53.743710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:53.744691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:53.746130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 69/146] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:53.751984 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139589a-bb74-43c6-b090-a76c2187d592 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:53.866245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e4d6f-04a4-44d2-bf38-d3ae7b4afb81 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:53.892802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139589a-bb74-43c6-b090-a76c2187d592 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:53.949382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64063b-9179-4c76-88fb-9244154037f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:53.949917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64063b-9179-4c76-88fb-9244154037f7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:53.950198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64063b-9179-4c76-88fb-9244154037f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:53.950466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64063b-9179-4c76-88fb-9244154037f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:53.951143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64063b-9179-4c76-88fb-9244154037f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:53.951448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64063b-9179-4c76-88fb-9244154037f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:53.952833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64063b-9179-4c76-88fb-9244154037f7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:53.970536 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 78/147] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:18:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:53.974720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64063b-9179-4c76-88fb-9244154037f7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:54.045474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:54.060153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e4d6f-04a4-44d2-bf38-d3ae7b4afb81 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:54.127771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a09a9-7439-49e5-a9d3-b509bd618847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:54.128419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a09a9-7439-49e5-a9d3-b509bd618847 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:54.128707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a09a9-7439-49e5-a9d3-b509bd618847 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:54.129006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a09a9-7439-49e5-a9d3-b509bd618847 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:54.134005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64063b-9179-4c76-88fb-9244154037f7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:54.151183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a09a9-7439-49e5-a9d3-b509bd618847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f10a09a9-7439-49e5-a9d3-b509bd618847 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:54.161317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:54.162159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:54.162894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 70/148] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:18:54.170089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a09a9-7439-49e5-a9d3-b509bd618847 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:54.219907 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243812bd-8618-4a15-a71d-c269fa553a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:54.220529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243812bd-8618-4a15-a71d-c269fa553a23 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:54.220815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243812bd-8618-4a15-a71d-c269fa553a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:54.221121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243812bd-8618-4a15-a71d-c269fa553a23 None admin] PATH_INFO: `/v3/users/06e92989261641b38e78bcbed08924de` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:54.222442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243812bd-8618-4a15-a71d-c269fa553a23 None admin] RBAC: Authorizing `identity:get_user(user_id=06e92989261641b38e78bcbed08924de)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:54.223909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243812bd-8618-4a15-a71d-c269fa553a23 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:54.228893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 79/149] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:53 2022] GET /identity/v3/users/06e92989261641b38e78bcbed08924de => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:54.236817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243812bd-8618-4a15-a71d-c269fa553a23 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:54.269364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:54.312038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a09a9-7439-49e5-a9d3-b509bd618847 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:54.365808 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8d556-824f-4181-b1e8-1f8bd6d6e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:54.366455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8d556-824f-4181-b1e8-1f8bd6d6e156 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:54.366895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8d556-824f-4181-b1e8-1f8bd6d6e156 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:54.367078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8d556-824f-4181-b1e8-1f8bd6d6e156 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:54.367826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8d556-824f-4181-b1e8-1f8bd6d6e156 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:54.368150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8d556-824f-4181-b1e8-1f8bd6d6e156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:54.370178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8d556-824f-4181-b1e8-1f8bd6d6e156 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:54.383543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 71/150] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:18:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:54.384759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43475423-5052-4e80-8589-f573d6e711e0 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:54.385087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43475423-5052-4e80-8589-f573d6e711e0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:54.385926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43475423-5052-4e80-8589-f573d6e711e0 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:54.387174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 72/151] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:54.394353 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43475423-5052-4e80-8589-f573d6e711e0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:54.444720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243812bd-8618-4a15-a71d-c269fa553a23 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:54.471378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:54.496969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ed954-84ed-4090-9f70-87d0a11f2d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:54.497645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ed954-84ed-4090-9f70-87d0a11f2d81 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:54.497927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ed954-84ed-4090-9f70-87d0a11f2d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:54.498202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ed954-84ed-4090-9f70-87d0a11f2d81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:54.536973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43475423-5052-4e80-8589-f573d6e711e0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:54.579594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:54.618764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87284bec-5369-4ce5-bd71-bdba3ad4f811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:54.619418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87284bec-5369-4ce5-bd71-bdba3ad4f811 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:54.620246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87284bec-5369-4ce5-bd71-bdba3ad4f811 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:54.620526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87284bec-5369-4ce5-bd71-bdba3ad4f811 None admin] PATH_INFO: `/v3/users/701188430312493b99fa6229ae7630ad` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:54.622453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87284bec-5369-4ce5-bd71-bdba3ad4f811 None admin] RBAC: Authorizing `identity:get_user(user_id=701188430312493b99fa6229ae7630ad)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:54.623898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87284bec-5369-4ce5-bd71-bdba3ad4f811 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:54.625524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 73/152] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:54 2022] GET /identity/v3/users/701188430312493b99fa6229ae7630ad => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:54.626651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8cdf5-17b8-41a5-b0c0-0e307928645e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:54.626921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8cdf5-17b8-41a5-b0c0-0e307928645e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:54.627188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8cdf5-17b8-41a5-b0c0-0e307928645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:54.635544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ed954-84ed-4090-9f70-87d0a11f2d81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:54.637037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ed954-84ed-4090-9f70-87d0a11f2d81 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:54.677575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-dfc8cdf5-17b8-41a5-b0c0-0e307928645e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:54.678776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-dfc8cdf5-17b8-41a5-b0c0-0e307928645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:54.849895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 74/153] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:54.850761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8cdf5-17b8-41a5-b0c0-0e307928645e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:54.858419 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 80/154] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:18:54.870618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ed954-84ed-4090-9f70-87d0a11f2d81 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:54.902995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:55.048128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8cdf5-17b8-41a5-b0c0-0e307928645e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:55.066222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ed954-84ed-4090-9f70-87d0a11f2d81 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:55.078586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:55.116666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91569a-afec-4cde-8efe-72cf8421eb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:55.117789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91569a-afec-4cde-8efe-72cf8421eb76 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:55.118075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91569a-afec-4cde-8efe-72cf8421eb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:55.118351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91569a-afec-4cde-8efe-72cf8421eb76 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:55.119474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d1f11-46cf-443a-be95-4d34b392bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:55.120787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d1f11-46cf-443a-be95-4d34b392bd41 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:55.121091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d1f11-46cf-443a-be95-4d34b392bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:55.121372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d1f11-46cf-443a-be95-4d34b392bd41 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:55.122503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91569a-afec-4cde-8efe-72cf8421eb76 None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:55.123955 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91569a-afec-4cde-8efe-72cf8421eb76 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:55.125621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 81/155] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:54 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:55.126270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d1f11-46cf-443a-be95-4d34b392bd41 None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:55.127700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d1f11-46cf-443a-be95-4d34b392bd41 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:55.129375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 75/156] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:54 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:55.133910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91569a-afec-4cde-8efe-72cf8421eb76 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:55.137842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d1f11-46cf-443a-be95-4d34b392bd41 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:55.337332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:55.364712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d1f11-46cf-443a-be95-4d34b392bd41 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:55.366356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91569a-afec-4cde-8efe-72cf8421eb76 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:55.426303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb424165-3253-41cc-abad-861efe4bf456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:55.426899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb424165-3253-41cc-abad-861efe4bf456 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:55.427188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb424165-3253-41cc-abad-861efe4bf456 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:55.427468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb424165-3253-41cc-abad-861efe4bf456 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681/users/701188430312493b99fa6229ae7630ad/roles/0f69d1c2776d4f3c912de690451a4697` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:55.434237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb424165-3253-41cc-abad-861efe4bf456 None admin] RBAC: Authorizing `identity:create_grant(project_id=353afc27991d4d4bbe4860b6b70da681, user_id=701188430312493b99fa6229ae7630ad, role_id=0f69d1c2776d4f3c912de690451a4697)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:55.435700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb424165-3253-41cc-abad-861efe4bf456 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:55.447123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194a5d4-49e4-4826-ae07-f4b148cf7a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:55.447768 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194a5d4-49e4-4826-ae07-f4b148cf7a95 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:55.448150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194a5d4-49e4-4826-ae07-f4b148cf7a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:55.448519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194a5d4-49e4-4826-ae07-f4b148cf7a95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:55.449292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194a5d4-49e4-4826-ae07-f4b148cf7a95 None admin] RBAC: Adding query filter params (role.id=d598e7097e2d496f971598b09965388a, scope.project.id=353afc27991d4d4bbe4860b6b70da681, user.id=06e92989261641b38e78bcbed08924de) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:55.449696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194a5d4-49e4-4826-ae07-f4b148cf7a95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:55.451126 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194a5d4-49e4-4826-ae07-f4b148cf7a95 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:55.463428 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 82/157] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:18:55 2022] GET /identity/v3/role_assignments?user.id=06e92989261641b38e78bcbed08924de&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=d598e7097e2d496f971598b09965388a => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:55.464226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194a5d4-49e4-4826-ae07-f4b148cf7a95 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:55.466446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 76/158] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:18:55 2022] PUT /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681/users/701188430312493b99fa6229ae7630ad/roles/0f69d1c2776d4f3c912de690451a4697 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:18:55.467593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1fb5-4b1e-4ef2-8617-0e03969b15d8 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:55.467866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1fb5-4b1e-4ef2-8617-0e03969b15d8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:55.468143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1fb5-4b1e-4ef2-8617-0e03969b15d8 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:55.469671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 77/159] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:55.475572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1184a-be32-44b3-a029-e9947856e4e3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:55.475888 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1184a-be32-44b3-a029-e9947856e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:55.476148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1184a-be32-44b3-a029-e9947856e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:55.514075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5da1184a-be32-44b3-a029-e9947856e4e3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:55.515327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5da1184a-be32-44b3-a029-e9947856e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:55.593195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:55.640885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194a5d4-49e4-4826-ae07-f4b148cf7a95 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:55.644624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 78/160] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:55.650120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae31823-1eee-4acb-9dc1-2b25b39390c5 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:55.650664 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae31823-1eee-4acb-9dc1-2b25b39390c5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:55.650991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae31823-1eee-4acb-9dc1-2b25b39390c5 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:55.652492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 79/161] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:55.684068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390191f-5628-4c7c-a543-6f3f121793a5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:55.684359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390191f-5628-4c7c-a543-6f3f121793a5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:55.684510 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390191f-5628-4c7c-a543-6f3f121793a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:55.710805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a390191f-5628-4c7c-a543-6f3f121793a5 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:55.712004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a390191f-5628-4c7c-a543-6f3f121793a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:55.716018 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1945966-18a2-40fa-ae71-e37b43b98e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:55.716665 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1945966-18a2-40fa-ae71-e37b43b98e81 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:55.716963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1945966-18a2-40fa-ae71-e37b43b98e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:55.717235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1945966-18a2-40fa-ae71-e37b43b98e81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:55.746667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1945966-18a2-40fa-ae71-e37b43b98e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b1945966-18a2-40fa-ae71-e37b43b98e81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:55.752210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:55.754705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:18:55.756626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 83/162] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:55.765242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1945966-18a2-40fa-ae71-e37b43b98e81 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:55.795366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:55.873222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 80/163] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:18:55.923813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1945966-18a2-40fa-ae71-e37b43b98e81 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:55.965639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdf9bb-7320-434f-b591-68a73312656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:55.966229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdf9bb-7320-434f-b591-68a73312656b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:55.966517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdf9bb-7320-434f-b591-68a73312656b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:55.966793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdf9bb-7320-434f-b591-68a73312656b None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:55.967467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdf9bb-7320-434f-b591-68a73312656b None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:55.967775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdf9bb-7320-434f-b591-68a73312656b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:55.969319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdf9bb-7320-434f-b591-68a73312656b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:55.979083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 84/164] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:18:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:55.985086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390191f-5628-4c7c-a543-6f3f121793a5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:56.128206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390191f-5628-4c7c-a543-6f3f121793a5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:56.139375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:56.166623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294a59c-effd-4d0f-b5a4-921cd9ac48c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:56.167259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a59c-effd-4d0f-b5a4-921cd9ac48c7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:56.169869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a59c-effd-4d0f-b5a4-921cd9ac48c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:56.170152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a59c-effd-4d0f-b5a4-921cd9ac48c7 None admin] PATH_INFO: `/v3/users/06e92989261641b38e78bcbed08924de` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:56.171370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294a59c-effd-4d0f-b5a4-921cd9ac48c7 None admin] RBAC: Authorizing `identity:get_user(user_id=06e92989261641b38e78bcbed08924de)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:56.172866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294a59c-effd-4d0f-b5a4-921cd9ac48c7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:56.174475 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 81/165] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:55 2022] GET /identity/v3/users/06e92989261641b38e78bcbed08924de => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:56.180171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdf9bb-7320-434f-b591-68a73312656b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:56.218285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294a59c-effd-4d0f-b5a4-921cd9ac48c7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:56.315973 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:56.374131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294a59c-effd-4d0f-b5a4-921cd9ac48c7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:56.374317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdf9bb-7320-434f-b591-68a73312656b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:56.412483 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c4dbc-fdf4-44e2-98e2-3efc42e5d7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:56.413443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c4dbc-fdf4-44e2-98e2-3efc42e5d7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:56.413921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c4dbc-fdf4-44e2-98e2-3efc42e5d7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:56.414338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c4dbc-fdf4-44e2-98e2-3efc42e5d7e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:56.426396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c4dbc-fdf4-44e2-98e2-3efc42e5d7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-736c4dbc-fdf4-44e2-98e2-3efc42e5d7e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:56.431647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:56.433313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:18:56.434523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:56.436919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 82/166] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:18:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:18:56.437970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c4dbc-fdf4-44e2-98e2-3efc42e5d7e5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:56.474912 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:56.542207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8acd7d-bcf9-43e3-a23a-d3a5f8833a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:56.542846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8acd7d-bcf9-43e3-a23a-d3a5f8833a17 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:56.543125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8acd7d-bcf9-43e3-a23a-d3a5f8833a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:56.543393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8acd7d-bcf9-43e3-a23a-d3a5f8833a17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:56.573132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c4dbc-fdf4-44e2-98e2-3efc42e5d7e5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:56.628032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3da62e-d3e5-4542-bd92-72e996766ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:56.628902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3da62e-d3e5-4542-bd92-72e996766ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:56.629373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3da62e-d3e5-4542-bd92-72e996766ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:56.630113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3da62e-d3e5-4542-bd92-72e996766ca1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:56.652045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3da62e-d3e5-4542-bd92-72e996766ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-5f3da62e-d3e5-4542-bd92-72e996766ca1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:56.660764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:56.661798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:56.662674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:18:56.665299 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 83/167] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:56.666280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3da62e-d3e5-4542-bd92-72e996766ca1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:56.746204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8acd7d-bcf9-43e3-a23a-d3a5f8833a17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:56.747593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8acd7d-bcf9-43e3-a23a-d3a5f8833a17 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:56.775273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:56.782455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3da62e-d3e5-4542-bd92-72e996766ca1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:56.818945 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0973df-ae25-448a-82c1-8a3c1feb6445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:56.819563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0973df-ae25-448a-82c1-8a3c1feb6445 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:56.819843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0973df-ae25-448a-82c1-8a3c1feb6445 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:56.820116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0973df-ae25-448a-82c1-8a3c1feb6445 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:56.820788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0973df-ae25-448a-82c1-8a3c1feb6445 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:56.821126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0973df-ae25-448a-82c1-8a3c1feb6445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:56.822482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0973df-ae25-448a-82c1-8a3c1feb6445 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:56.834398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 84/168] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:18:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:56.835183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0973df-ae25-448a-82c1-8a3c1feb6445 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:56.938347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0973df-ae25-448a-82c1-8a3c1feb6445 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:56.955994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:56.973599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cf95e-c2a2-46a2-8beb-a33f4f79deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:56.974212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cf95e-c2a2-46a2-8beb-a33f4f79deb8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:56.974494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cf95e-c2a2-46a2-8beb-a33f4f79deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:56.976980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cf95e-c2a2-46a2-8beb-a33f4f79deb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:56.976980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cf95e-c2a2-46a2-8beb-a33f4f79deb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:56.976980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cf95e-c2a2-46a2-8beb-a33f4f79deb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:56.977216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cf95e-c2a2-46a2-8beb-a33f4f79deb8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:56.986480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 85/169] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:56.987290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cf95e-c2a2-46a2-8beb-a33f4f79deb8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:56.998868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 85/170] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 819 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:18:56.999694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8acd7d-bcf9-43e3-a23a-d3a5f8833a17 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:57.013322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:57.089554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cf95e-c2a2-46a2-8beb-a33f4f79deb8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:57.124759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411ca85-5b01-4a9c-8179-8c3048d7564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:57.125476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ca85-5b01-4a9c-8179-8c3048d7564e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:57.125758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ca85-5b01-4a9c-8179-8c3048d7564e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:57.126032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ca85-5b01-4a9c-8179-8c3048d7564e None admin] PATH_INFO: `/v3/users/06e92989261641b38e78bcbed08924de` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:57.130307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411ca85-5b01-4a9c-8179-8c3048d7564e None admin] RBAC: Authorizing `identity:get_user(user_id=06e92989261641b38e78bcbed08924de)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:57.131745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411ca85-5b01-4a9c-8179-8c3048d7564e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:57.133550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 86/171] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:56 2022] GET /identity/v3/users/06e92989261641b38e78bcbed08924de => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:57.135789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411ca85-5b01-4a9c-8179-8c3048d7564e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:57.232477 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8acd7d-bcf9-43e3-a23a-d3a5f8833a17 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:57.253066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411ca85-5b01-4a9c-8179-8c3048d7564e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:57.253489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:57.306406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e17bc-2248-4e20-ae7f-60e5e7fecdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:57.307114 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e17bc-2248-4e20-ae7f-60e5e7fecdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:57.307897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e17bc-2248-4e20-ae7f-60e5e7fecdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:57.308177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e17bc-2248-4e20-ae7f-60e5e7fecdc4 None admin] PATH_INFO: `/v3/projects/8d8496d348304de38eee83bd9624d7eb` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:57.309681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e17bc-2248-4e20-ae7f-60e5e7fecdc4 None admin] RBAC: Authorizing `identity:get_project(project_id=8d8496d348304de38eee83bd9624d7eb)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:57.311406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e17bc-2248-4e20-ae7f-60e5e7fecdc4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:57.313247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 87/172] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:57 2022] GET /identity/v3/projects/8d8496d348304de38eee83bd9624d7eb => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:57.313837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e17bc-2248-4e20-ae7f-60e5e7fecdc4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:57.323863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b6c1d-79db-46a8-bdb0-319bd4953537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:57.324776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6c1d-79db-46a8-bdb0-319bd4953537 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:57.325269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6c1d-79db-46a8-bdb0-319bd4953537 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:57.325733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6c1d-79db-46a8-bdb0-319bd4953537 None admin] PATH_INFO: `/v3/users/d64b74222381414fa028861d4cb5842c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:57.329627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b6c1d-79db-46a8-bdb0-319bd4953537 None admin] RBAC: Authorizing `identity:get_user(user_id=d64b74222381414fa028861d4cb5842c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:57.331327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b6c1d-79db-46a8-bdb0-319bd4953537 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:57.333137 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 86/173] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:56 2022] GET /identity/v3/users/d64b74222381414fa028861d4cb5842c => generated 247 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:57.334080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b6c1d-79db-46a8-bdb0-319bd4953537 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:57.429442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:57.532631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e17bc-2248-4e20-ae7f-60e5e7fecdc4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:57.541147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b6c1d-79db-46a8-bdb0-319bd4953537 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:57.595536 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aeeb6-cf7a-4b98-ab61-145a383b9012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:57.596171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aeeb6-cf7a-4b98-ab61-145a383b9012 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:57.596453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aeeb6-cf7a-4b98-ab61-145a383b9012 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:57.596727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aeeb6-cf7a-4b98-ab61-145a383b9012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:57.597512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aeeb6-cf7a-4b98-ab61-145a383b9012 None admin] RBAC: Adding query filter params (role.id=d598e7097e2d496f971598b09965388a, scope.project.id=8d8496d348304de38eee83bd9624d7eb, user.id=06e92989261641b38e78bcbed08924de) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:57.597827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aeeb6-cf7a-4b98-ab61-145a383b9012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:57.599287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aeeb6-cf7a-4b98-ab61-145a383b9012 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:57.611822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 87/174] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:18:57 2022] GET /identity/v3/role_assignments?user.id=06e92989261641b38e78bcbed08924de&scope.project.id=8d8496d348304de38eee83bd9624d7eb&role.id=d598e7097e2d496f971598b09965388a => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:57.612484 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aeeb6-cf7a-4b98-ab61-145a383b9012 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:57.613501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65866750-99c8-482d-8e92-5a1ee458f98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:57.614120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65866750-99c8-482d-8e92-5a1ee458f98d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:57.614401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65866750-99c8-482d-8e92-5a1ee458f98d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:57.614675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65866750-99c8-482d-8e92-5a1ee458f98d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:57.657909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:57.731319 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65866750-99c8-482d-8e92-5a1ee458f98d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:57.732939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65866750-99c8-482d-8e92-5a1ee458f98d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:57.774409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aeeb6-cf7a-4b98-ab61-145a383b9012 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:57.782761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:57.819303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef479fc-84d9-4a91-a5d3-5d32ea9404a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:57.820581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef479fc-84d9-4a91-a5d3-5d32ea9404a2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:57.821061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef479fc-84d9-4a91-a5d3-5d32ea9404a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:57.821555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef479fc-84d9-4a91-a5d3-5d32ea9404a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:57.871223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 88/175] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:18:57.872740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e775a4e-6f59-4132-b816-ba2ea15f0da8 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:57.881514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e775a4e-6f59-4132-b816-ba2ea15f0da8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:57.882761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e775a4e-6f59-4132-b816-ba2ea15f0da8 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:57.884285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 89/176] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:57.885560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1e31-738e-4ed5-a3d4-5fdc8d9618d4 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:57.885844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1e31-738e-4ed5-a3d4-5fdc8d9618d4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:57.886120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1e31-738e-4ed5-a3d4-5fdc8d9618d4 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:57.894906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 90/177] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:57.895761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1e31-738e-4ed5-a3d4-5fdc8d9618d4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:57.951890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef479fc-84d9-4a91-a5d3-5d32ea9404a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:57.953511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef479fc-84d9-4a91-a5d3-5d32ea9404a2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:57.976893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:58.031541 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1e31-738e-4ed5-a3d4-5fdc8d9618d4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:58.069161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 88/178] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:18:58.070311 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d28ef-cdac-473f-bc69-b50c08d18c4f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:58.070594 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d28ef-cdac-473f-bc69-b50c08d18c4f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:58.070866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d28ef-cdac-473f-bc69-b50c08d18c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:58.074370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd21b9-7bf1-4d82-868f-5580d143f8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:58.075010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd21b9-7bf1-4d82-868f-5580d143f8ab None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:58.075287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd21b9-7bf1-4d82-868f-5580d143f8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:58.075556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd21b9-7bf1-4d82-868f-5580d143f8ab None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:58.076662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd21b9-7bf1-4d82-868f-5580d143f8ab None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:58.078202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd21b9-7bf1-4d82-868f-5580d143f8ab None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:58.079831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 91/179] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:57 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:58.080927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7b807-5f6a-43ab-95d6-f02bd4df85bc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:58.081223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7b807-5f6a-43ab-95d6-f02bd4df85bc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:58.081494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7b807-5f6a-43ab-95d6-f02bd4df85bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:58.089908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:58.096793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-858d28ef-cdac-473f-bc69-b50c08d18c4f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:58.098033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-858d28ef-cdac-473f-bc69-b50c08d18c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:58.103474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-eab7b807-5f6a-43ab-95d6-f02bd4df85bc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:58.104627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-eab7b807-5f6a-43ab-95d6-f02bd4df85bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:58.180697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 89/180] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:58.181817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd217e2-1e22-4bfc-9c9c-bd54edb6f4d9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:58.182131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd217e2-1e22-4bfc-9c9c-bd54edb6f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:58.182404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd217e2-1e22-4bfc-9c9c-bd54edb6f4d9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:58.183647 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 90/181] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:58.188328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd217e2-1e22-4bfc-9c9c-bd54edb6f4d9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:58.195886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 92/182] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:58.197600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7b807-5f6a-43ab-95d6-f02bd4df85bc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:58.273941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:58.328236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7b807-5f6a-43ab-95d6-f02bd4df85bc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:58.368484 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd217e2-1e22-4bfc-9c9c-bd54edb6f4d9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:58.372278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe852b-2109-4bb5-b3d7-7a15b4a6e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:58.373154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe852b-2109-4bb5-b3d7-7a15b4a6e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:58.373661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe852b-2109-4bb5-b3d7-7a15b4a6e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:58.374133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe852b-2109-4bb5-b3d7-7a15b4a6e3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:58.375090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe852b-2109-4bb5-b3d7-7a15b4a6e3c5 None admin] RBAC: Adding query filter params (role.id=d742575a6b40459fbb329defa3b642c5, scope.project.id=353afc27991d4d4bbe4860b6b70da681, user.id=06e92989261641b38e78bcbed08924de) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:58.375602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe852b-2109-4bb5-b3d7-7a15b4a6e3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:58.377318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe852b-2109-4bb5-b3d7-7a15b4a6e3c5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:58.385048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 93/183] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:18:58 2022] GET /identity/v3/role_assignments?user.id=06e92989261641b38e78bcbed08924de&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=d742575a6b40459fbb329defa3b642c5 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:58.392976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd96d-d8fd-42fc-b16b-28642f62b8d4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:58.393755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd96d-d8fd-42fc-b16b-28642f62b8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:58.394239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd96d-d8fd-42fc-b16b-28642f62b8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:58.428846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-166cd96d-d8fd-42fc-b16b-28642f62b8d4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:58.431262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-166cd96d-d8fd-42fc-b16b-28642f62b8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:58.461812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c81c97-46e6-4587-b4e7-545c3cfe3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:58.462464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c81c97-46e6-4587-b4e7-545c3cfe3347 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:58.462803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c81c97-46e6-4587-b4e7-545c3cfe3347 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:58.463077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c81c97-46e6-4587-b4e7-545c3cfe3347 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:58.466873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c81c97-46e6-4587-b4e7-545c3cfe3347 None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:58.468364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c81c97-46e6-4587-b4e7-545c3cfe3347 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:58.471164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 91/184] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:58 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:58.471985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c81c97-46e6-4587-b4e7-545c3cfe3347 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:58.477481 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:58.576681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 94/185] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:58.577388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd96d-d8fd-42fc-b16b-28642f62b8d4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:58.648443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:58.668082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c81c97-46e6-4587-b4e7-545c3cfe3347 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:58.715022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac454c6-45ed-462b-bfb0-0773532ba91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:58.715658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac454c6-45ed-462b-bfb0-0773532ba91a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:58.715935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac454c6-45ed-462b-bfb0-0773532ba91a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:58.716203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac454c6-45ed-462b-bfb0-0773532ba91a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:58.722474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd96d-d8fd-42fc-b16b-28642f62b8d4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:58.729431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac454c6-45ed-462b-bfb0-0773532ba91a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6ac454c6-45ed-462b-bfb0-0773532ba91a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:58.735206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:58.736131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:18:58.736902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:18:58.738093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 92/186] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:18:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:58.738679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac454c6-45ed-462b-bfb0-0773532ba91a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:58.774554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d0b66-5caf-4b6e-b2f7-eb3ae8b18ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:58.776726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0b66-5caf-4b6e-b2f7-eb3ae8b18ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:58.777485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0b66-5caf-4b6e-b2f7-eb3ae8b18ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:58.777980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0b66-5caf-4b6e-b2f7-eb3ae8b18ee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:58.779554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d0b66-5caf-4b6e-b2f7-eb3ae8b18ee3 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=353afc27991d4d4bbe4860b6b70da681, user.id=d64b74222381414fa028861d4cb5842c) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:58.780330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d0b66-5caf-4b6e-b2f7-eb3ae8b18ee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:58.782008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d0b66-5caf-4b6e-b2f7-eb3ae8b18ee3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:58.789940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 95/187] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:18:58 2022] GET /identity/v3/role_assignments?user.id=d64b74222381414fa028861d4cb5842c&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:58.790966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d0b66-5caf-4b6e-b2f7-eb3ae8b18ee3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:58.841375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:58.917234 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac454c6-45ed-462b-bfb0-0773532ba91a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:58.968546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d0b66-5caf-4b6e-b2f7-eb3ae8b18ee3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:58.980900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:59.005816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a09c3-fdbf-4437-a632-77fae5f91f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:59.006572 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a09c3-fdbf-4437-a632-77fae5f91f08 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.006958 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a09c3-fdbf-4437-a632-77fae5f91f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.007235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a09c3-fdbf-4437-a632-77fae5f91f08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.008841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a70bd-3565-45a5-a1a8-8c77dc0dbc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:59.009777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a70bd-3565-45a5-a1a8-8c77dc0dbc98 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.010878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a70bd-3565-45a5-a1a8-8c77dc0dbc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.011241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a70bd-3565-45a5-a1a8-8c77dc0dbc98 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.011999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a70bd-3565-45a5-a1a8-8c77dc0dbc98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:59.012377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a70bd-3565-45a5-a1a8-8c77dc0dbc98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:59.014177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a70bd-3565-45a5-a1a8-8c77dc0dbc98 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:59.020854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a09c3-fdbf-4437-a632-77fae5f91f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:18:59.023744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 96/188] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:59.024675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a70bd-3565-45a5-a1a8-8c77dc0dbc98 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-296a09c3-fdbf-4437-a632-77fae5f91f08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:18:59.029054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:18:59.029976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:18:59.030760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:18:59.031355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 93/189] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:18:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:18:59.033331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a09c3-fdbf-4437-a632-77fae5f91f08 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:59.144349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a70bd-3565-45a5-a1a8-8c77dc0dbc98 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:59.151956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a09c3-fdbf-4437-a632-77fae5f91f08 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:59.174889 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:59.177628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330ea9-45f0-4a15-a840-7074da467e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:59.178257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330ea9-45f0-4a15-a840-7074da467e25 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.178541 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330ea9-45f0-4a15-a840-7074da467e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.178815 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330ea9-45f0-4a15-a840-7074da467e25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.179915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2330ea9-45f0-4a15-a840-7074da467e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:59.181388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2330ea9-45f0-4a15-a840-7074da467e25 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:59.183132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 97/190] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:18:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:59.183718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330ea9-45f0-4a15-a840-7074da467e25 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:59.189116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454f949-8eb6-4779-befe-d500cce99615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:59.189750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454f949-8eb6-4779-befe-d500cce99615 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.190031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454f949-8eb6-4779-befe-d500cce99615 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.190304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454f949-8eb6-4779-befe-d500cce99615 None admin] PATH_INFO: `/v3/users/77bb317a76a04ccd9fa57dc919baa661` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.204591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454f949-8eb6-4779-befe-d500cce99615 None admin] RBAC: Authorizing `identity:get_user(user_id=77bb317a76a04ccd9fa57dc919baa661)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:59.206067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454f949-8eb6-4779-befe-d500cce99615 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:59.207824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 94/191] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:59 2022] GET /identity/v3/users/77bb317a76a04ccd9fa57dc919baa661 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:18:59.208821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6670321-51d4-49ae-af75-5092b25a1379 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.209125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6670321-51d4-49ae-af75-5092b25a1379 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.209398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6670321-51d4-49ae-af75-5092b25a1379 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.210569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 95/192] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:18:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:18:59.211234 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6670321-51d4-49ae-af75-5092b25a1379 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:59.229558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:59.287392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330ea9-45f0-4a15-a840-7074da467e25 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:59.313436 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6670321-51d4-49ae-af75-5092b25a1379 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:59.319345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321347f-7263-4c4d-98c3-033ae1f80a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:59.319953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321347f-7263-4c4d-98c3-033ae1f80a89 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.320237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321347f-7263-4c4d-98c3-033ae1f80a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.320517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321347f-7263-4c4d-98c3-033ae1f80a89 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.321212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321347f-7263-4c4d-98c3-033ae1f80a89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:18:59.321521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321347f-7263-4c4d-98c3-033ae1f80a89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:59.323399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321347f-7263-4c4d-98c3-033ae1f80a89 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:59.331335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 98/193] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:18:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:59.333594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321347f-7263-4c4d-98c3-033ae1f80a89 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:59.346999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebb500-e319-45d4-980d-8ef10f2b7aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:59.347609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebb500-e319-45d4-980d-8ef10f2b7aae None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.347884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebb500-e319-45d4-980d-8ef10f2b7aae None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.348150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebb500-e319-45d4-980d-8ef10f2b7aae None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.348792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebb500-e319-45d4-980d-8ef10f2b7aae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:59.350235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebb500-e319-45d4-980d-8ef10f2b7aae None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:59.374748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 96/194] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:18:59 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:18:59.382520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e14ce-613f-434a-aa7f-f24d3922aa10 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.382818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e14ce-613f-434a-aa7f-f24d3922aa10 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.383212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e14ce-613f-434a-aa7f-f24d3922aa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.403877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-754e14ce-613f-434a-aa7f-f24d3922aa10 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:18:59.405152 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-754e14ce-613f-434a-aa7f-f24d3922aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:18:59.438264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:59.445170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321347f-7263-4c4d-98c3-033ae1f80a89 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:59.446947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:59.483098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 97/195] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:18:59.484002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf93b6-93f7-4108-9705-5349c00ffbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:59.484130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e14ce-613f-434a-aa7f-f24d3922aa10 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:59.484900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf93b6-93f7-4108-9705-5349c00ffbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.485364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf93b6-93f7-4108-9705-5349c00ffbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.485776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf93b6-93f7-4108-9705-5349c00ffbd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.579189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf93b6-93f7-4108-9705-5349c00ffbd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:59.580249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf93b6-93f7-4108-9705-5349c00ffbd9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:59.636044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e14ce-613f-434a-aa7f-f24d3922aa10 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:59.678466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0297d1-1f7b-4d65-a3cc-77fb5451843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:59.679452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0297d1-1f7b-4d65-a3cc-77fb5451843c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.679946 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0297d1-1f7b-4d65-a3cc-77fb5451843c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.680478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0297d1-1f7b-4d65-a3cc-77fb5451843c None admin] PATH_INFO: `/v3/users/77bb317a76a04ccd9fa57dc919baa661` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.681930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0297d1-1f7b-4d65-a3cc-77fb5451843c None admin] RBAC: Authorizing `identity:get_user(user_id=77bb317a76a04ccd9fa57dc919baa661)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:59.683540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0297d1-1f7b-4d65-a3cc-77fb5451843c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:59.685309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 98/196] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:18:59 2022] GET /identity/v3/users/77bb317a76a04ccd9fa57dc919baa661 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:59.692039 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0297d1-1f7b-4d65-a3cc-77fb5451843c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:59.722623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 99/197] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:18:59.729665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf93b6-93f7-4108-9705-5349c00ffbd9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:59.732016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:59.739318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:18:59.823604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0297d1-1f7b-4d65-a3cc-77fb5451843c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:59.867003 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3816c-e45d-4db9-8d9c-999380ec60ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:59.867560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf93b6-93f7-4108-9705-5349c00ffbd9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:18:59.867667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3816c-e45d-4db9-8d9c-999380ec60ef None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.867884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3816c-e45d-4db9-8d9c-999380ec60ef None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.868157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3816c-e45d-4db9-8d9c-999380ec60ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.911775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8117a38-61d5-47c3-90c0-0851f713d2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:18:59.912418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117a38-61d5-47c3-90c0-0851f713d2fb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:18:59.912708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117a38-61d5-47c3-90c0-0851f713d2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:18:59.913009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117a38-61d5-47c3-90c0-0851f713d2fb None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:18:59.914215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8117a38-61d5-47c3-90c0-0851f713d2fb None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:59.916285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8117a38-61d5-47c3-90c0-0851f713d2fb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:59.919680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 100/198] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:18:59 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:18:59.920727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8117a38-61d5-47c3-90c0-0851f713d2fb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:18:59.947423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3816c-e45d-4db9-8d9c-999380ec60ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:18:59.949752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3816c-e45d-4db9-8d9c-999380ec60ef None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:18:59.987741 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:00.013446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:00.042470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8117a38-61d5-47c3-90c0-0851f713d2fb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:00.064147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 99/199] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:18:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:00.064147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3816c-e45d-4db9-8d9c-999380ec60ef None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:00.092636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef5bd-5ec7-4735-a0f0-908f3df6ecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:00.093333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef5bd-5ec7-4735-a0f0-908f3df6ecbd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:00.094022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef5bd-5ec7-4735-a0f0-908f3df6ecbd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:00.094022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef5bd-5ec7-4735-a0f0-908f3df6ecbd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:00.105982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fef5bd-5ec7-4735-a0f0-908f3df6ecbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-23fef5bd-5ec7-4735-a0f0-908f3df6ecbd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:00.111633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:00.112512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:00.113337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 101/200] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:18:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:00.113963 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef5bd-5ec7-4735-a0f0-908f3df6ecbd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:00.201608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3816c-e45d-4db9-8d9c-999380ec60ef None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:00.229430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef5bd-5ec7-4735-a0f0-908f3df6ecbd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:00.251878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279037e-7e09-4065-a496-655cd72d8000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:00.253278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279037e-7e09-4065-a496-655cd72d8000 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:00.254016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279037e-7e09-4065-a496-655cd72d8000 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:00.254469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279037e-7e09-4065-a496-655cd72d8000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:00.256184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279037e-7e09-4065-a496-655cd72d8000 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=a101cbee2fb049a984083ce237c81fe9, user.id=77bb317a76a04ccd9fa57dc919baa661) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:00.256854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279037e-7e09-4065-a496-655cd72d8000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:00.259258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279037e-7e09-4065-a496-655cd72d8000 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:00.262095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:00.265142 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:00.269465 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27accb49-9b1b-4f89-a6a8-f2abf8727a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:00.269987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 100/201] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:00 2022] GET /identity/v3/role_assignments?user.id=77bb317a76a04ccd9fa57dc919baa661&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:00.270249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27accb49-9b1b-4f89-a6a8-f2abf8727a36 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:00.270654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27accb49-9b1b-4f89-a6a8-f2abf8727a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:00.270993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27accb49-9b1b-4f89-a6a8-f2abf8727a36 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:00.271873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279037e-7e09-4065-a496-655cd72d8000 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:00.272314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27accb49-9b1b-4f89-a6a8-f2abf8727a36 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:00.273906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27accb49-9b1b-4f89-a6a8-f2abf8727a36 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:00.276598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 102/202] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:00 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:00.283332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27accb49-9b1b-4f89-a6a8-f2abf8727a36 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:00.410421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27accb49-9b1b-4f89-a6a8-f2abf8727a36 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:00.447177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279037e-7e09-4065-a496-655cd72d8000 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:00.451994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177f10e-347a-4891-8d48-da11f46b37b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:00.452852 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177f10e-347a-4891-8d48-da11f46b37b7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:00.453365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177f10e-347a-4891-8d48-da11f46b37b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:00.453854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177f10e-347a-4891-8d48-da11f46b37b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:00.454797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177f10e-347a-4891-8d48-da11f46b37b7 None admin] RBAC: Adding query filter params (role.id=d742575a6b40459fbb329defa3b642c5, scope.project.id=a101cbee2fb049a984083ce237c81fe9, user.id=77bb317a76a04ccd9fa57dc919baa661) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:00.455425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177f10e-347a-4891-8d48-da11f46b37b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:00.457196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177f10e-347a-4891-8d48-da11f46b37b7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:00.464314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 103/203] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:00 2022] GET /identity/v3/role_assignments?user.id=77bb317a76a04ccd9fa57dc919baa661&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=d742575a6b40459fbb329defa3b642c5 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:00.493068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f9e2a-6bbc-44e9-b0ad-a33ce6e5f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:00.494061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f9e2a-6bbc-44e9-b0ad-a33ce6e5f912 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:00.495078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f9e2a-6bbc-44e9-b0ad-a33ce6e5f912 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:00.495552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f9e2a-6bbc-44e9-b0ad-a33ce6e5f912 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:00.496451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f9e2a-6bbc-44e9-b0ad-a33ce6e5f912 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:00.497042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f9e2a-6bbc-44e9-b0ad-a33ce6e5f912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:00.498712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f9e2a-6bbc-44e9-b0ad-a33ce6e5f912 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:00.508723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 101/204] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:00.518175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177f10e-347a-4891-8d48-da11f46b37b7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:00.609731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:00.660097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177f10e-347a-4891-8d48-da11f46b37b7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:00.699187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdef26-de7f-427f-b3a7-08d19b549036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:00.700178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdef26-de7f-427f-b3a7-08d19b549036 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:00.700723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdef26-de7f-427f-b3a7-08d19b549036 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:00.701065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdef26-de7f-427f-b3a7-08d19b549036 None admin] PATH_INFO: `/v3/users/701188430312493b99fa6229ae7630ad` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:00.702272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdef26-de7f-427f-b3a7-08d19b549036 None admin] RBAC: Authorizing `identity:get_user(user_id=701188430312493b99fa6229ae7630ad)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:00.703672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdef26-de7f-427f-b3a7-08d19b549036 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:00.705618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 104/205] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:00 2022] GET /identity/v3/users/701188430312493b99fa6229ae7630ad => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:00.710752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f9e2a-6bbc-44e9-b0ad-a33ce6e5f912 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:00.793183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:00.847801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f9e2a-6bbc-44e9-b0ad-a33ce6e5f912 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:00.886227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9562afb-ff6c-4179-88ff-986a60552107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:00.886835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9562afb-ff6c-4179-88ff-986a60552107 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:00.887112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9562afb-ff6c-4179-88ff-986a60552107 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:00.887383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9562afb-ff6c-4179-88ff-986a60552107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:00.984486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9562afb-ff6c-4179-88ff-986a60552107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:00.985883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9562afb-ff6c-4179-88ff-986a60552107 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:01.063740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:01.109600 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 102/206] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:01.123142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdef26-de7f-427f-b3a7-08d19b549036 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:01.234910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdef26-de7f-427f-b3a7-08d19b549036 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:01.263584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:01.270436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f037921-7ae9-474f-b130-102eb6ec63ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:01.271083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f037921-7ae9-474f-b130-102eb6ec63ea None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:01.271365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f037921-7ae9-474f-b130-102eb6ec63ea None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:01.271636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f037921-7ae9-474f-b130-102eb6ec63ea None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:01.272750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f037921-7ae9-474f-b130-102eb6ec63ea None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:01.274206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f037921-7ae9-474f-b130-102eb6ec63ea None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:01.276622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 105/207] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:01 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:01.284750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9562afb-ff6c-4179-88ff-986a60552107 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:01.427061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9562afb-ff6c-4179-88ff-986a60552107 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:01.472020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a391e5-c462-4229-999c-e8b069a1dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:01.472624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a391e5-c462-4229-999c-e8b069a1dbca None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:01.472901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a391e5-c462-4229-999c-e8b069a1dbca None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:01.473194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a391e5-c462-4229-999c-e8b069a1dbca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:01.473919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a391e5-c462-4229-999c-e8b069a1dbca None admin] RBAC: Adding query filter params (role.id=0f69d1c2776d4f3c912de690451a4697, scope.project.id=353afc27991d4d4bbe4860b6b70da681, user.id=701188430312493b99fa6229ae7630ad) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:01.474223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a391e5-c462-4229-999c-e8b069a1dbca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:01.475648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a391e5-c462-4229-999c-e8b069a1dbca None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:01.485323 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 103/208] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:01 2022] GET /identity/v3/role_assignments?user.id=701188430312493b99fa6229ae7630ad&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=0f69d1c2776d4f3c912de690451a4697 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:02.168038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f0892-4a5c-4d47-b407-c00600f975d4 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:02.168559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f0892-4a5c-4d47-b407-c00600f975d4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:02.168559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f0892-4a5c-4d47-b407-c00600f975d4 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:02.170222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 106/209] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:02.175493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b0121-c3b7-4eb7-8bf2-e5f4aed5e59d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:02.176028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b0121-c3b7-4eb7-8bf2-e5f4aed5e59d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:02.176493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b0121-c3b7-4eb7-8bf2-e5f4aed5e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:02.200114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7e3b0121-c3b7-4eb7-8bf2-e5f4aed5e59d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:02.201411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7e3b0121-c3b7-4eb7-8bf2-e5f4aed5e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:02.225523 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:02.275218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 104/210] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:02.332638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c35688-638f-4aa2-8a0c-80e79363edca None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:02.332991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c35688-638f-4aa2-8a0c-80e79363edca None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:02.333215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c35688-638f-4aa2-8a0c-80e79363edca None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:02.334699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 107/211] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:02.340702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2633ee9-ec56-4c46-b889-6668ed265837 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:02.341151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2633ee9-ec56-4c46-b889-6668ed265837 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:02.341332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2633ee9-ec56-4c46-b889-6668ed265837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:02.368509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b2633ee9-ec56-4c46-b889-6668ed265837 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:02.370133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b2633ee9-ec56-4c46-b889-6668ed265837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:02.436787 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:02.555033 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c35688-638f-4aa2-8a0c-80e79363edca None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:02.661775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c35688-638f-4aa2-8a0c-80e79363edca None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:02.697930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aec1b6-df68-479b-83f8-c7d4dcec677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:02.698962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec1b6-df68-479b-83f8-c7d4dcec677f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:02.699483 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec1b6-df68-479b-83f8-c7d4dcec677f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:02.699977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec1b6-df68-479b-83f8-c7d4dcec677f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:02.703588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2633ee9-ec56-4c46-b889-6668ed265837 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:02.711433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aec1b6-df68-479b-83f8-c7d4dcec677f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-44aec1b6-df68-479b-83f8-c7d4dcec677f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:02.716826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:02.717753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:02.718518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 108/213] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:02.724265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aec1b6-df68-479b-83f8-c7d4dcec677f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:02.789322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:02.806000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:02.827044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2633ee9-ec56-4c46-b889-6668ed265837 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:02.834466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aec1b6-df68-479b-83f8-c7d4dcec677f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:02.870113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb8193-947b-4f91-9b0a-1d9404df187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:02.871041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb8193-947b-4f91-9b0a-1d9404df187c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:02.871330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb8193-947b-4f91-9b0a-1d9404df187c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:02.871606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb8193-947b-4f91-9b0a-1d9404df187c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:02.872940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb8193-947b-4f91-9b0a-1d9404df187c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:02.875123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb8193-947b-4f91-9b0a-1d9404df187c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:02.876927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:02.882324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb8193-947b-4f91-9b0a-1d9404df187c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:02.886592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7457e-aaa7-4811-b4d5-d61ed81d878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:02.887525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7457e-aaa7-4811-b4d5-d61ed81d878d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:02.888021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7457e-aaa7-4811-b4d5-d61ed81d878d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:02.888505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7457e-aaa7-4811-b4d5-d61ed81d878d None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:02.889413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7457e-aaa7-4811-b4d5-d61ed81d878d None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:02.889912 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7457e-aaa7-4811-b4d5-d61ed81d878d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:02.891596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7457e-aaa7-4811-b4d5-d61ed81d878d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:02.902212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 109/215] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:02.912968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7457e-aaa7-4811-b4d5-d61ed81d878d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:02.989733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb8193-947b-4f91-9b0a-1d9404df187c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:03.023187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7457e-aaa7-4811-b4d5-d61ed81d878d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:03.029261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcfb3f-5df7-42ef-bc28-3b86bfb91cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:03.029876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcfb3f-5df7-42ef-bc28-3b86bfb91cf1 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.030154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcfb3f-5df7-42ef-bc28-3b86bfb91cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.030420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcfb3f-5df7-42ef-bc28-3b86bfb91cf1 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.031072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcfb3f-5df7-42ef-bc28-3b86bfb91cf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:03.032998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcfb3f-5df7-42ef-bc28-3b86bfb91cf1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:03.044144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:03.059403 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 107/216] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:19:02 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:19:03.060596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bc984-902e-4cd9-9c64-88497d784be2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.060883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bc984-902e-4cd9-9c64-88497d784be2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.061189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bc984-902e-4cd9-9c64-88497d784be2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.064993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 108/217] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:03.068310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807d99-79cb-488d-a36e-7251acf607ab None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.068637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807d99-79cb-488d-a36e-7251acf607ab None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.068914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807d99-79cb-488d-a36e-7251acf607ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.070075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebc7ef-ad9c-4d87-9977-ce75aed6dd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:03.070736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc7ef-ad9c-4d87-9977-ce75aed6dd42 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.071020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc7ef-ad9c-4d87-9977-ce75aed6dd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.071297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc7ef-ad9c-4d87-9977-ce75aed6dd42 None admin] PATH_INFO: `/v3/users/6649e68300574a7380212e60a37443aa` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.088655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-62807d99-79cb-488d-a36e-7251acf607ab None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:03.089895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-62807d99-79cb-488d-a36e-7251acf607ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:03.094187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:03.103020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebc7ef-ad9c-4d87-9977-ce75aed6dd42 None admin] RBAC: Authorizing `identity:get_user(user_id=6649e68300574a7380212e60a37443aa)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:03.106176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebc7ef-ad9c-4d87-9977-ce75aed6dd42 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:03.109986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 110/218] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:02 2022] GET /identity/v3/users/6649e68300574a7380212e60a37443aa => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:03.114564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b08a-6624-4997-9f29-82c996176abf None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.114862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b08a-6624-4997-9f29-82c996176abf None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.115137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b08a-6624-4997-9f29-82c996176abf None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.116636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 111/219] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:19:03.117243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678b08a-6624-4997-9f29-82c996176abf None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:03.179213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 109/220] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:03.182498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73545541-46cf-4847-aef3-af5272a6f68e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.182976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73545541-46cf-4847-aef3-af5272a6f68e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.184107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73545541-46cf-4847-aef3-af5272a6f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.215075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-73545541-46cf-4847-aef3-af5272a6f68e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:03.217419 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-73545541-46cf-4847-aef3-af5272a6f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:03.243755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678b08a-6624-4997-9f29-82c996176abf None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:03.291064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da19d77-3e75-42a7-aaa6-79a8a90219d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:03.292215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da19d77-3e75-42a7-aaa6-79a8a90219d3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.292689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da19d77-3e75-42a7-aaa6-79a8a90219d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.292868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da19d77-3e75-42a7-aaa6-79a8a90219d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.300733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 110/221] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:03.344177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:03.373377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da19d77-3e75-42a7-aaa6-79a8a90219d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:03.374838 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da19d77-3e75-42a7-aaa6-79a8a90219d3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:03.451851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73545541-46cf-4847-aef3-af5272a6f68e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:03.487371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 112/222] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:03.496423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da19d77-3e75-42a7-aaa6-79a8a90219d3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:03.545885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:03.586253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73545541-46cf-4847-aef3-af5272a6f68e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:03.593064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:03.622424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da19d77-3e75-42a7-aaa6-79a8a90219d3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:03.638378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77245c61-bd30-4eea-85c7-d004df8ff449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:03.639347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77245c61-bd30-4eea-85c7-d004df8ff449 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.639821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77245c61-bd30-4eea-85c7-d004df8ff449 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.640283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77245c61-bd30-4eea-85c7-d004df8ff449 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.652564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77245c61-bd30-4eea-85c7-d004df8ff449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-77245c61-bd30-4eea-85c7-d004df8ff449 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:03.658228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:03.659071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:19:03.659863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:03.660434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b0cd3-b605-4e8c-997b-d78923b66c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:03.660434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b0cd3-b605-4e8c-997b-d78923b66c38 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.661109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b0cd3-b605-4e8c-997b-d78923b66c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.661109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b0cd3-b605-4e8c-997b-d78923b66c38 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.662065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b0cd3-b605-4e8c-997b-d78923b66c38 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:03.663027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 111/223] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:03.663571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b0cd3-b605-4e8c-997b-d78923b66c38 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:03.664251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77245c61-bd30-4eea-85c7-d004df8ff449 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:03.669571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 113/224] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:03 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:03.670868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b0cd3-b605-4e8c-997b-d78923b66c38 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:03.778195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b0cd3-b605-4e8c-997b-d78923b66c38 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:03.778994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77245c61-bd30-4eea-85c7-d004df8ff449 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:03.810517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:03.816747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ce79-67bb-468c-ad94-4ab6f2b13700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:03.817222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ecc5-bd3e-4f45-bf35-719af02aa609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:03.817854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ce79-67bb-468c-ad94-4ab6f2b13700 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.818217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ecc5-bd3e-4f45-bf35-719af02aa609 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.818547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ce79-67bb-468c-ad94-4ab6f2b13700 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.818655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ecc5-bd3e-4f45-bf35-719af02aa609 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.819024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ecc5-bd3e-4f45-bf35-719af02aa609 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.819182 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ce79-67bb-468c-ad94-4ab6f2b13700 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.820044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281ecc5-bd3e-4f45-bf35-719af02aa609 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:03.820444 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281ecc5-bd3e-4f45-bf35-719af02aa609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:03.822026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281ecc5-bd3e-4f45-bf35-719af02aa609 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:03.831306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18ce79-67bb-468c-ad94-4ab6f2b13700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:03.836303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 114/225] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:03.836303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ecc5-bd3e-4f45-bf35-719af02aa609 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fa18ce79-67bb-468c-ad94-4ab6f2b13700 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:03.841493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:03.842551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:03.843492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:03.845520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 112/226] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:19:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:03.846442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ce79-67bb-468c-ad94-4ab6f2b13700 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:03.847171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:03.948848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ecc5-bd3e-4f45-bf35-719af02aa609 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:03.957183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ce79-67bb-468c-ad94-4ab6f2b13700 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:03.993122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce7127-50b1-4980-9e55-fb9e29ef490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:03.993728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce7127-50b1-4980-9e55-fb9e29ef490b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:03.994013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce7127-50b1-4980-9e55-fb9e29ef490b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:03.994367 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce7127-50b1-4980-9e55-fb9e29ef490b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:03.995106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce7127-50b1-4980-9e55-fb9e29ef490b None admin] RBAC: Adding query filter params (role.id=d598e7097e2d496f971598b09965388a, scope.project.id=a101cbee2fb049a984083ce237c81fe9, user.id=6649e68300574a7380212e60a37443aa) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:03.995409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce7127-50b1-4980-9e55-fb9e29ef490b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:03.996837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce7127-50b1-4980-9e55-fb9e29ef490b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:03.998760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a2a8b-9839-4cb5-b1d3-f2100e9cbb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:03.999627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a2a8b-9839-4cb5-b1d3-f2100e9cbb36 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:04.000159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a2a8b-9839-4cb5-b1d3-f2100e9cbb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:04.000618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a2a8b-9839-4cb5-b1d3-f2100e9cbb36 None admin] PATH_INFO: `/v3/users/77bb317a76a04ccd9fa57dc919baa661` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:04.001993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a2a8b-9839-4cb5-b1d3-f2100e9cbb36 None admin] RBAC: Authorizing `identity:get_user(user_id=77bb317a76a04ccd9fa57dc919baa661)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:04.002701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 115/227] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:03 2022] GET /identity/v3/role_assignments?user.id=6649e68300574a7380212e60a37443aa&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=d598e7097e2d496f971598b09965388a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:04.003493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce7127-50b1-4980-9e55-fb9e29ef490b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:04.004295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a2a8b-9839-4cb5-b1d3-f2100e9cbb36 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:04.006595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 113/228] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:03 2022] GET /identity/v3/users/77bb317a76a04ccd9fa57dc919baa661 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:04.016999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a2a8b-9839-4cb5-b1d3-f2100e9cbb36 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:04.116227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:04.159641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce7127-50b1-4980-9e55-fb9e29ef490b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:04.174977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:04.208911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc14645-8d98-4f1b-94ab-67d3e770142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:04.209696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc14645-8d98-4f1b-94ab-67d3e770142f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:04.210094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc14645-8d98-4f1b-94ab-67d3e770142f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:04.210414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc14645-8d98-4f1b-94ab-67d3e770142f None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:04.211086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc14645-8d98-4f1b-94ab-67d3e770142f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:04.211391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc14645-8d98-4f1b-94ab-67d3e770142f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:04.212749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc14645-8d98-4f1b-94ab-67d3e770142f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:04.227935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 116/229] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:04.228115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a2a8b-9839-4cb5-b1d3-f2100e9cbb36 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:04.229168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc14645-8d98-4f1b-94ab-67d3e770142f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:04.278825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b462f14-fa31-42eb-9a2c-79003d0d67b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:04.279457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b462f14-fa31-42eb-9a2c-79003d0d67b6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:04.279733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b462f14-fa31-42eb-9a2c-79003d0d67b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:04.280007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b462f14-fa31-42eb-9a2c-79003d0d67b6 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:04.281291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b462f14-fa31-42eb-9a2c-79003d0d67b6 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:04.282859 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b462f14-fa31-42eb-9a2c-79003d0d67b6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:04.284812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 114/230] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:04 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:04.290842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b462f14-fa31-42eb-9a2c-79003d0d67b6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:04.448257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc14645-8d98-4f1b-94ab-67d3e770142f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:04.488502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b462f14-fa31-42eb-9a2c-79003d0d67b6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:04.515268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cad259-2d83-45c8-8715-6a4fa0b6edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:04.515908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad259-2d83-45c8-8715-6a4fa0b6edcf None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:04.516185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad259-2d83-45c8-8715-6a4fa0b6edcf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:04.516454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad259-2d83-45c8-8715-6a4fa0b6edcf None admin] PATH_INFO: `/v3/users/77bb317a76a04ccd9fa57dc919baa661` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:04.519185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cad259-2d83-45c8-8715-6a4fa0b6edcf None admin] RBAC: Authorizing `identity:get_user(user_id=77bb317a76a04ccd9fa57dc919baa661)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:04.520604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cad259-2d83-45c8-8715-6a4fa0b6edcf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:04.522227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 117/231] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:04 2022] GET /identity/v3/users/77bb317a76a04ccd9fa57dc919baa661 => generated 283 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:04.528889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cad259-2d83-45c8-8715-6a4fa0b6edcf None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:04.531910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:04.549352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:04.557557 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd6780-26c8-4974-866b-009ea2fb831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:04.558459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd6780-26c8-4974-866b-009ea2fb831b None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:04.558803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd6780-26c8-4974-866b-009ea2fb831b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:04.559079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd6780-26c8-4974-866b-009ea2fb831b None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9/users/77bb317a76a04ccd9fa57dc919baa661/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:04.561415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd6780-26c8-4974-866b-009ea2fb831b None admin] RBAC: Authorizing `identity:create_grant(project_id=a101cbee2fb049a984083ce237c81fe9, user_id=77bb317a76a04ccd9fa57dc919baa661, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:04.563043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd6780-26c8-4974-866b-009ea2fb831b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:04.578136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 115/232] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:19:04 2022] PUT /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9/users/77bb317a76a04ccd9fa57dc919baa661/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:19:04.744335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cad259-2d83-45c8-8715-6a4fa0b6edcf None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:04.805455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b5479-616d-48d3-af51-c8ab6bac91d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:04.806801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5479-616d-48d3-af51-c8ab6bac91d4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:04.807344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5479-616d-48d3-af51-c8ab6bac91d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:04.808052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5479-616d-48d3-af51-c8ab6bac91d4 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:04.809953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b5479-616d-48d3-af51-c8ab6bac91d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:04.812553 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b5479-616d-48d3-af51-c8ab6bac91d4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:04.815618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 118/233] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:04 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:04.821640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd6780-26c8-4974-866b-009ea2fb831b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:04.950646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd6780-26c8-4974-866b-009ea2fb831b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:04.992442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324f07b-0ca1-42ca-bef7-59af306b76d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:04.993506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324f07b-0ca1-42ca-bef7-59af306b76d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:04.993992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324f07b-0ca1-42ca-bef7-59af306b76d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:04.995062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324f07b-0ca1-42ca-bef7-59af306b76d5 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9/users/77bb317a76a04ccd9fa57dc919baa661/roles/d742575a6b40459fbb329defa3b642c5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:04.997494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324f07b-0ca1-42ca-bef7-59af306b76d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a101cbee2fb049a984083ce237c81fe9, user_id=77bb317a76a04ccd9fa57dc919baa661, role_id=d742575a6b40459fbb329defa3b642c5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:04.999171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324f07b-0ca1-42ca-bef7-59af306b76d5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:05.023983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 116/234] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:19:04 2022] PUT /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9/users/77bb317a76a04ccd9fa57dc919baa661/roles/d742575a6b40459fbb329defa3b642c5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:05.804251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b619-f1eb-4da6-978a-8fbada97e75e None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:05.804751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b619-f1eb-4da6-978a-8fbada97e75e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:05.804751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b619-f1eb-4da6-978a-8fbada97e75e None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:05.806218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 119/235] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:05.811867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cd18-f8b5-49c6-a102-4993bc08627c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:05.812259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cd18-f8b5-49c6-a102-4993bc08627c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:05.812444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cd18-f8b5-49c6-a102-4993bc08627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:05.831951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-82f3cd18-f8b5-49c6-a102-4993bc08627c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:05.833221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-82f3cd18-f8b5-49c6-a102-4993bc08627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:05.902020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:05.931992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 117/236] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:05.996411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adb197-ccaf-4206-8aba-2144adaa4f7c None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:05.997063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adb197-ccaf-4206-8aba-2144adaa4f7c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:05.997548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adb197-ccaf-4206-8aba-2144adaa4f7c None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:05.999389 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 120/237] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:06.010463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cfd77-eb9d-474c-ac87-6334c410eb73 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:06.010756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cfd77-eb9d-474c-ac87-6334c410eb73 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:06.011037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cfd77-eb9d-474c-ac87-6334c410eb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:06.034687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3b4cfd77-eb9d-474c-ac87-6334c410eb73 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:06.035875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3b4cfd77-eb9d-474c-ac87-6334c410eb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:06.137168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 118/238] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:06.227682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adb197-ccaf-4206-8aba-2144adaa4f7c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:06.332168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:06.375793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adb197-ccaf-4206-8aba-2144adaa4f7c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:06.421801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4aa66e-d186-4fe3-b402-627490b9e900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:06.422355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aa66e-d186-4fe3-b402-627490b9e900 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:06.422638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aa66e-d186-4fe3-b402-627490b9e900 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:06.422924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aa66e-d186-4fe3-b402-627490b9e900 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:06.441765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4aa66e-d186-4fe3-b402-627490b9e900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ec4aa66e-d186-4fe3-b402-627490b9e900 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:06.446876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:06.447871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:06.448648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:06.451208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 121/239] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:06.462041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cfd77-eb9d-474c-ac87-6334c410eb73 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:06.534294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4aa66e-d186-4fe3-b402-627490b9e900 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:06.637874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cfd77-eb9d-474c-ac87-6334c410eb73 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:06.646749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:06.676829 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe9889-abe2-4975-986e-765417c26e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:06.677054 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4aa66e-d186-4fe3-b402-627490b9e900 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:06.677926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9889-abe2-4975-986e-765417c26e5c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:06.678531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9889-abe2-4975-986e-765417c26e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:06.679027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe9889-abe2-4975-986e-765417c26e5c None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:06.679922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe9889-abe2-4975-986e-765417c26e5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:06.680433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe9889-abe2-4975-986e-765417c26e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:06.682531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe9889-abe2-4975-986e-765417c26e5c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:06.691978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 119/240] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:06.698631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f247-37a3-4e88-9cbe-d59addb0700c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:06.698631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f247-37a3-4e88-9cbe-d59addb0700c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:06.698631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f247-37a3-4e88-9cbe-d59addb0700c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:06.698631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 120/241] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:06.698631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0f247-37a3-4e88-9cbe-d59addb0700c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:06.712922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:06.719521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e8b6f-2f3c-4c3b-a790-58ad23988fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:06.720160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8b6f-2f3c-4c3b-a790-58ad23988fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:06.720440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8b6f-2f3c-4c3b-a790-58ad23988fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:06.720710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8b6f-2f3c-4c3b-a790-58ad23988fc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:06.721866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8b6f-2f3c-4c3b-a790-58ad23988fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:06.723305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8b6f-2f3c-4c3b-a790-58ad23988fc2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:06.725279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 122/242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:06.726553 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b9f2a-f23b-42be-adf5-7ce32fec3c02 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:06.726838 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b9f2a-f23b-42be-adf5-7ce32fec3c02 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:06.727107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b9f2a-f23b-42be-adf5-7ce32fec3c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:06.746264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-463b9f2a-f23b-42be-adf5-7ce32fec3c02 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:06.747501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-463b9f2a-f23b-42be-adf5-7ce32fec3c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:06.813292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0f247-37a3-4e88-9cbe-d59addb0700c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:06.816407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 123/243] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:06.817401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b9f2a-f23b-42be-adf5-7ce32fec3c02 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:06.886609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4cc41-5d3b-4ab3-a062-034e7427991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:06.887254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4cc41-5d3b-4ab3-a062-034e7427991a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:06.887536 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4cc41-5d3b-4ab3-a062-034e7427991a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:06.887813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4cc41-5d3b-4ab3-a062-034e7427991a None admin] PATH_INFO: `/v3/users/b763e656205e40a19abb38112bb0b312` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:06.919324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4cc41-5d3b-4ab3-a062-034e7427991a None admin] RBAC: Authorizing `identity:get_user(user_id=b763e656205e40a19abb38112bb0b312)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:06.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4cc41-5d3b-4ab3-a062-034e7427991a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:06.922813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 121/244] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:06 2022] GET /identity/v3/users/b763e656205e40a19abb38112bb0b312 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:06.928611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b9f2a-f23b-42be-adf5-7ce32fec3c02 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:06.938073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4cc41-5d3b-4ab3-a062-034e7427991a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:06.956657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:06.965886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93171884-0ec1-4778-baee-5ca90efbb6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:06.966504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93171884-0ec1-4778-baee-5ca90efbb6b5 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:06.966782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93171884-0ec1-4778-baee-5ca90efbb6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:06.967052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93171884-0ec1-4778-baee-5ca90efbb6b5 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:06.967694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93171884-0ec1-4778-baee-5ca90efbb6b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:06.969145 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93171884-0ec1-4778-baee-5ca90efbb6b5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:06.985339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:07.006624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 124/245] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:19:06 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:19:07.105129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4cc41-5d3b-4ab3-a062-034e7427991a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:07.141402 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bc24a-ae6b-4451-91a3-f60a2df475bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:07.142024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bc24a-ae6b-4451-91a3-f60a2df475bf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:07.142303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bc24a-ae6b-4451-91a3-f60a2df475bf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:07.142572 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bc24a-ae6b-4451-91a3-f60a2df475bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:07.197233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93171884-0ec1-4778-baee-5ca90efbb6b5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:07.216462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bc24a-ae6b-4451-91a3-f60a2df475bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:07.218015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bc24a-ae6b-4451-91a3-f60a2df475bf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:07.246790 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:07.331529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 122/246] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 10:19:07.336887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bc24a-ae6b-4451-91a3-f60a2df475bf None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:07.390156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93171884-0ec1-4778-baee-5ca90efbb6b5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:07.439035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1201edc-615a-4c84-8fe4-26371fc85fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:07.439688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1201edc-615a-4c84-8fe4-26371fc85fad None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:07.439969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1201edc-615a-4c84-8fe4-26371fc85fad None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:07.440244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1201edc-615a-4c84-8fe4-26371fc85fad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:07.455198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1201edc-615a-4c84-8fe4-26371fc85fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a1201edc-615a-4c84-8fe4-26371fc85fad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:07.461754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:07.462726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:07.464125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 125/247] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:19:07.471402 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1201edc-615a-4c84-8fe4-26371fc85fad None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:07.473210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bc24a-ae6b-4451-91a3-f60a2df475bf None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:07.504462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:07.516541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72822dfd-45d7-435b-a72b-7d8e6a14fa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:07.517485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72822dfd-45d7-435b-a72b-7d8e6a14fa29 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:07.517914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72822dfd-45d7-435b-a72b-7d8e6a14fa29 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:07.518327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72822dfd-45d7-435b-a72b-7d8e6a14fa29 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:07.520777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72822dfd-45d7-435b-a72b-7d8e6a14fa29 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:07.522267 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72822dfd-45d7-435b-a72b-7d8e6a14fa29 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:07.524089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 123/248] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:07 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:07.526341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e035b-101b-44df-a078-71be9af9fac8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:07.526629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e035b-101b-44df-a078-71be9af9fac8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:07.526906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e035b-101b-44df-a078-71be9af9fac8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:07.528644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 124/249] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:07.530603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e035b-101b-44df-a078-71be9af9fac8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:07.532713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:07.621684 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1201edc-615a-4c84-8fe4-26371fc85fad None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:07.669545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e035b-101b-44df-a078-71be9af9fac8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:07.673191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d62be-305d-4d38-9c39-cd8b1f48966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:07.674038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d62be-305d-4d38-9c39-cd8b1f48966f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:07.674490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d62be-305d-4d38-9c39-cd8b1f48966f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:07.674908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d62be-305d-4d38-9c39-cd8b1f48966f None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:07.675737 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d62be-305d-4d38-9c39-cd8b1f48966f None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:07.676043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d62be-305d-4d38-9c39-cd8b1f48966f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:07.677452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d62be-305d-4d38-9c39-cd8b1f48966f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:07.689228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 126/250] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:07.689228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ac0d-5017-4447-8240-780c3eddf1da None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:07.689228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ac0d-5017-4447-8240-780c3eddf1da None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:07.689228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ac0d-5017-4447-8240-780c3eddf1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:07.711047 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4e33ac0d-5017-4447-8240-780c3eddf1da None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:07.712687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4e33ac0d-5017-4447-8240-780c3eddf1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:07.721725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cdf0-5d15-4d26-9dc7-e043f1c7c302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:07.722711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cdf0-5d15-4d26-9dc7-e043f1c7c302 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:07.722990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cdf0-5d15-4d26-9dc7-e043f1c7c302 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:07.723256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cdf0-5d15-4d26-9dc7-e043f1c7c302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:07.723980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2cdf0-5d15-4d26-9dc7-e043f1c7c302 None admin] RBAC: Adding query filter params (role.id=0f69d1c2776d4f3c912de690451a4697, scope.project.id=a101cbee2fb049a984083ce237c81fe9, user.id=b763e656205e40a19abb38112bb0b312) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:07.724285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2cdf0-5d15-4d26-9dc7-e043f1c7c302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:07.725868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2cdf0-5d15-4d26-9dc7-e043f1c7c302 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:07.732341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 125/251] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:07 2022] GET /identity/v3/role_assignments?user.id=b763e656205e40a19abb38112bb0b312&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=0f69d1c2776d4f3c912de690451a4697 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:07.740983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cdf0-5d15-4d26-9dc7-e043f1c7c302 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:07.820061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:07.825158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 127/252] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:07.826866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0e934-5e42-4527-a233-869aeee42aa8 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:07.827058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0e934-5e42-4527-a233-869aeee42aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:07.827307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0e934-5e42-4527-a233-869aeee42aa8 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:07.829175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 128/253] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:07.835497 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d215-cab9-41ef-b5e2-354d17be3891 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:07.836171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d215-cab9-41ef-b5e2-354d17be3891 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:07.836594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d215-cab9-41ef-b5e2-354d17be3891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:07.859861 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c109d215-cab9-41ef-b5e2-354d17be3891 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:07.862057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c109d215-cab9-41ef-b5e2-354d17be3891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:07.875752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cdf0-5d15-4d26-9dc7-e043f1c7c302 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:07.902325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:07.918623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e13b7e-b6fc-45c0-a8ec-967fdd08e063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:07.919266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13b7e-b6fc-45c0-a8ec-967fdd08e063 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:07.919548 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13b7e-b6fc-45c0-a8ec-967fdd08e063 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:07.919824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13b7e-b6fc-45c0-a8ec-967fdd08e063 None admin] PATH_INFO: `/v3/users/6649e68300574a7380212e60a37443aa` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:07.921028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e13b7e-b6fc-45c0-a8ec-967fdd08e063 None admin] RBAC: Authorizing `identity:get_user(user_id=6649e68300574a7380212e60a37443aa)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:07.923193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e13b7e-b6fc-45c0-a8ec-967fdd08e063 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:07.925709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 126/254] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:07 2022] GET /identity/v3/users/6649e68300574a7380212e60a37443aa => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:07.933327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e13b7e-b6fc-45c0-a8ec-967fdd08e063 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:07.959782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 129/255] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:08.075341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e13b7e-b6fc-45c0-a8ec-967fdd08e063 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:08.101637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:08.111365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480c22-b324-4188-95b6-e3882b590d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:08.112003 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480c22-b324-4188-95b6-e3882b590d6e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:08.112289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480c22-b324-4188-95b6-e3882b590d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:08.112562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480c22-b324-4188-95b6-e3882b590d6e None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:08.113706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480c22-b324-4188-95b6-e3882b590d6e None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:08.115158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480c22-b324-4188-95b6-e3882b590d6e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:08.116934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 127/256] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:07 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:08.123849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109d215-cab9-41ef-b5e2-354d17be3891 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:08.244431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109d215-cab9-41ef-b5e2-354d17be3891 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:08.250237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480c22-b324-4188-95b6-e3882b590d6e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:08.310498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfcbf1-62bd-486f-b34f-95822a5971e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:08.311472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfcbf1-62bd-486f-b34f-95822a5971e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:08.311963 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfcbf1-62bd-486f-b34f-95822a5971e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:08.313236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfcbf1-62bd-486f-b34f-95822a5971e9 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9/users/6649e68300574a7380212e60a37443aa/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:08.319676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfcbf1-62bd-486f-b34f-95822a5971e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a101cbee2fb049a984083ce237c81fe9, user_id=6649e68300574a7380212e60a37443aa, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:08.321537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfcbf1-62bd-486f-b34f-95822a5971e9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:08.344348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 130/257] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:19:08 2022] PUT /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9/users/6649e68300574a7380212e60a37443aa/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:08.420392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480c22-b324-4188-95b6-e3882b590d6e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:08.462196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b6f97-961a-46ee-9038-984654f1f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:08.463350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b6f97-961a-46ee-9038-984654f1f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:08.463860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b6f97-961a-46ee-9038-984654f1f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:08.464372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b6f97-961a-46ee-9038-984654f1f9f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:08.480477 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b6f97-961a-46ee-9038-984654f1f9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:08.482192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfcbf1-62bd-486f-b34f-95822a5971e9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-184b6f97-961a-46ee-9038-984654f1f9f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:08.488385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:08.489370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:19:08.490151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:08.492418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 128/258] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:19:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:08.498886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b6f97-961a-46ee-9038-984654f1f9f4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:08.534489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:08.608107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:08.679586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfcbf1-62bd-486f-b34f-95822a5971e9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:08.693367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b6f97-961a-46ee-9038-984654f1f9f4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:08.748046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b3f9-1340-4d76-bebe-f8df3d4ae8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:08.748689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b3f9-1340-4d76-bebe-f8df3d4ae8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:08.748979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b3f9-1340-4d76-bebe-f8df3d4ae8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:08.749256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b3f9-1340-4d76-bebe-f8df3d4ae8b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:08.752727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21fb17-d507-43f1-85a7-26f9adb5ae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:08.753367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21fb17-d507-43f1-85a7-26f9adb5ae9b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:08.753641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21fb17-d507-43f1-85a7-26f9adb5ae9b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:08.753911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21fb17-d507-43f1-85a7-26f9adb5ae9b None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:08.758065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21fb17-d507-43f1-85a7-26f9adb5ae9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:08.758376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21fb17-d507-43f1-85a7-26f9adb5ae9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:08.759812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21fb17-d507-43f1-85a7-26f9adb5ae9b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:08.777982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9b3f9-1340-4d76-bebe-f8df3d4ae8b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:08.789243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 129/259] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d3b9b3f9-1340-4d76-bebe-f8df3d4ae8b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:08.790539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:08.791456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:08.792284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 131/260] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:19:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:08.798349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21fb17-d507-43f1-85a7-26f9adb5ae9b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:08.798632 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b3f9-1340-4d76-bebe-f8df3d4ae8b2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:09.037407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:09.048461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21fb17-d507-43f1-85a7-26f9adb5ae9b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:09.060172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b3f9-1340-4d76-bebe-f8df3d4ae8b2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:09.087725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:09.127673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e92eb-8edb-4f13-8e20-a52e20d9b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:09.128742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e92eb-8edb-4f13-8e20-a52e20d9b5eb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:09.129244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e92eb-8edb-4f13-8e20-a52e20d9b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:09.129723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e92eb-8edb-4f13-8e20-a52e20d9b5eb None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:09.130672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e92eb-8edb-4f13-8e20-a52e20d9b5eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:09.131171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e92eb-8edb-4f13-8e20-a52e20d9b5eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:09.132711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e92eb-8edb-4f13-8e20-a52e20d9b5eb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:09.133633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d36bf9-22e2-48d3-bb27-46c34dd40a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:09.134283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d36bf9-22e2-48d3-bb27-46c34dd40a05 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:09.134573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d36bf9-22e2-48d3-bb27-46c34dd40a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:09.135550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d36bf9-22e2-48d3-bb27-46c34dd40a05 None admin] PATH_INFO: `/v3/users/77bb317a76a04ccd9fa57dc919baa661` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:09.136773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d36bf9-22e2-48d3-bb27-46c34dd40a05 None admin] RBAC: Authorizing `identity:get_user(user_id=77bb317a76a04ccd9fa57dc919baa661)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:09.138278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d36bf9-22e2-48d3-bb27-46c34dd40a05 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:09.139867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 130/261] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:08 2022] GET /identity/v3/users/77bb317a76a04ccd9fa57dc919baa661 => generated 283 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:09.143328 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 132/262] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:09.149044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d36bf9-22e2-48d3-bb27-46c34dd40a05 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:09.157768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e92eb-8edb-4f13-8e20-a52e20d9b5eb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:09.326402 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d36bf9-22e2-48d3-bb27-46c34dd40a05 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:09.363117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e92eb-8edb-4f13-8e20-a52e20d9b5eb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:09.404062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf2a9d-de8c-43bf-b523-efef58f4687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:09.404732 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf2a9d-de8c-43bf-b523-efef58f4687c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:09.405039 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf2a9d-de8c-43bf-b523-efef58f4687c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:09.405314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf2a9d-de8c-43bf-b523-efef58f4687c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:09.453664 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12fb37-a40f-4d8a-9b56-dcfe9bc36d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:09.454315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12fb37-a40f-4d8a-9b56-dcfe9bc36d8b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:09.454598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12fb37-a40f-4d8a-9b56-dcfe9bc36d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:09.454877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12fb37-a40f-4d8a-9b56-dcfe9bc36d8b None admin] PATH_INFO: `/v3/users/77bb317a76a04ccd9fa57dc919baa661` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:09.456115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12fb37-a40f-4d8a-9b56-dcfe9bc36d8b None admin] RBAC: Authorizing `identity:get_user(user_id=77bb317a76a04ccd9fa57dc919baa661)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:09.457583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12fb37-a40f-4d8a-9b56-dcfe9bc36d8b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:09.459484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 133/263] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:09 2022] GET /identity/v3/users/77bb317a76a04ccd9fa57dc919baa661 => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:09.465731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12fb37-a40f-4d8a-9b56-dcfe9bc36d8b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:09.506687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:09.508379 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:09.527470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf2a9d-de8c-43bf-b523-efef58f4687c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:09.530872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf2a9d-de8c-43bf-b523-efef58f4687c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:09.673939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12fb37-a40f-4d8a-9b56-dcfe9bc36d8b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:09.716270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 131/264] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:09.736743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf2a9d-de8c-43bf-b523-efef58f4687c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:09.738616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f0eae-5a35-4764-8877-1920916bf9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:09.739238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f0eae-5a35-4764-8877-1920916bf9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:09.739518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f0eae-5a35-4764-8877-1920916bf9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:09.739792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f0eae-5a35-4764-8877-1920916bf9b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:09.809915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f0eae-5a35-4764-8877-1920916bf9b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:09.811389 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f0eae-5a35-4764-8877-1920916bf9b3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:09.833653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:09.897406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:09.915065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf2a9d-de8c-43bf-b523-efef58f4687c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:09.915252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 134/265] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 10:19:09.920926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f0eae-5a35-4764-8877-1920916bf9b3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:09.979986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85439060-c2bf-4fa2-b263-6e6af05811bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:09.980800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439060-c2bf-4fa2-b263-6e6af05811bc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:09.981112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439060-c2bf-4fa2-b263-6e6af05811bc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:09.981482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439060-c2bf-4fa2-b263-6e6af05811bc None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:09.985733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85439060-c2bf-4fa2-b263-6e6af05811bc None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:09.987411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85439060-c2bf-4fa2-b263-6e6af05811bc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:09.989269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 132/266] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:09 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:09.999234 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85439060-c2bf-4fa2-b263-6e6af05811bc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:10.026612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f0eae-5a35-4764-8877-1920916bf9b3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:10.043971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:10.069517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164e223-e53d-466b-9faa-8158358752f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:10.070155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164e223-e53d-466b-9faa-8158358752f6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:10.070437 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164e223-e53d-466b-9faa-8158358752f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:10.070709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164e223-e53d-466b-9faa-8158358752f6 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:10.074074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164e223-e53d-466b-9faa-8158358752f6 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:10.075526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164e223-e53d-466b-9faa-8158358752f6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:10.078683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 135/267] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:09 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:10.084917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164e223-e53d-466b-9faa-8158358752f6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:10.200353 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85439060-c2bf-4fa2-b263-6e6af05811bc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:10.266484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164e223-e53d-466b-9faa-8158358752f6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:10.274614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3edfef-bcd8-4968-aa0f-871a00753b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:10.275243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3edfef-bcd8-4968-aa0f-871a00753b21 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:10.276313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3edfef-bcd8-4968-aa0f-871a00753b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:10.276583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3edfef-bcd8-4968-aa0f-871a00753b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:10.277345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3edfef-bcd8-4968-aa0f-871a00753b21 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=a101cbee2fb049a984083ce237c81fe9, user.id=77bb317a76a04ccd9fa57dc919baa661) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:10.277655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3edfef-bcd8-4968-aa0f-871a00753b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:10.279110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3edfef-bcd8-4968-aa0f-871a00753b21 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:10.296539 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 133/268] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:09 2022] GET /identity/v3/role_assignments?user.id=77bb317a76a04ccd9fa57dc919baa661&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:10.336637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b5bfa-03e6-43a0-b7b6-42b3473f0b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:10.337284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b5bfa-03e6-43a0-b7b6-42b3473f0b50 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:10.337565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b5bfa-03e6-43a0-b7b6-42b3473f0b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:10.337892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b5bfa-03e6-43a0-b7b6-42b3473f0b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:10.338632 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b5bfa-03e6-43a0-b7b6-42b3473f0b50 None admin] RBAC: Adding query filter params (role.id=d742575a6b40459fbb329defa3b642c5, scope.project.id=a101cbee2fb049a984083ce237c81fe9, user.id=77bb317a76a04ccd9fa57dc919baa661) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:10.338938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b5bfa-03e6-43a0-b7b6-42b3473f0b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:10.340369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b5bfa-03e6-43a0-b7b6-42b3473f0b50 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:10.346767 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 136/269] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:10 2022] GET /identity/v3/role_assignments?user.id=77bb317a76a04ccd9fa57dc919baa661&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=d742575a6b40459fbb329defa3b642c5 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:10.443335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894d0d-11f6-47a4-b02f-1b9239d29390 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:10.443663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894d0d-11f6-47a4-b02f-1b9239d29390 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:10.443893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894d0d-11f6-47a4-b02f-1b9239d29390 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:10.445646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 134/270] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:10.451716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9bfd-ce50-42be-a9a7-a97b7c31ffe1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:10.452039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9bfd-ce50-42be-a9a7-a97b7c31ffe1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:10.452272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9bfd-ce50-42be-a9a7-a97b7c31ffe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:10.478219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-121c9bfd-ce50-42be-a9a7-a97b7c31ffe1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:10.480017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-121c9bfd-ce50-42be-a9a7-a97b7c31ffe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:10.539688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:10.570444 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 137/271] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:10.668635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8896d-41bd-486d-822d-cda00ae710fc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:10.668918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8896d-41bd-486d-822d-cda00ae710fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:10.669400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8896d-41bd-486d-822d-cda00ae710fc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:10.671138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 135/272] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:10.677160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0eaec-5147-438b-bf52-e57aba411641 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:10.677706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0eaec-5147-438b-bf52-e57aba411641 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:10.678142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0eaec-5147-438b-bf52-e57aba411641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:10.699250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-99b0eaec-5147-438b-bf52-e57aba411641 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:10.700671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-99b0eaec-5147-438b-bf52-e57aba411641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:10.770020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 138/273] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:10.922628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8896d-41bd-486d-822d-cda00ae710fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:10.936485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5becc4-253d-47e0-8f1e-d819a653645b None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:10.936485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5becc4-253d-47e0-8f1e-d819a653645b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:10.936485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5becc4-253d-47e0-8f1e-d819a653645b None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:10.936485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 139/274] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:19:10.942132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc084d-be86-447b-8c82-61b69fa5b8b7 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:10.942570 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc084d-be86-447b-8c82-61b69fa5b8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:10.942995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc084d-be86-447b-8c82-61b69fa5b8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:10.948751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:10.963028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a6dc084d-be86-447b-8c82-61b69fa5b8b7 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:10.964199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a6dc084d-be86-447b-8c82-61b69fa5b8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:11.069180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 140/275] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:11.080974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8896d-41bd-486d-822d-cda00ae710fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:11.089287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc084d-be86-447b-8c82-61b69fa5b8b7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:11.123629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc91b-7a9b-447d-8687-733e781f3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:11.124547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc91b-7a9b-447d-8687-733e781f3586 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:11.124833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc91b-7a9b-447d-8687-733e781f3586 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:11.125135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc91b-7a9b-447d-8687-733e781f3586 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:11.137887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfc91b-7a9b-447d-8687-733e781f3586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:11.138975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9ecfc91b-7a9b-447d-8687-733e781f3586 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:11.146501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:11.147380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:11.148173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 136/276] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:11.153946 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc91b-7a9b-447d-8687-733e781f3586 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:11.211641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc084d-be86-447b-8c82-61b69fa5b8b7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:11.252498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:11.253816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410313-9142-4e34-afb5-23353e1f1246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:11.254551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410313-9142-4e34-afb5-23353e1f1246 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:11.254929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410313-9142-4e34-afb5-23353e1f1246 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:11.255307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410313-9142-4e34-afb5-23353e1f1246 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:11.256571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f410313-9142-4e34-afb5-23353e1f1246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:11.258165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f410313-9142-4e34-afb5-23353e1f1246 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:11.260570 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 141/277] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:11.266711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410313-9142-4e34-afb5-23353e1f1246 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:11.284922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc91b-7a9b-447d-8687-733e781f3586 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:11.321620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3b571-fc78-4d14-ac46-3dfe2b03aeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:11.323092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3b571-fc78-4d14-ac46-3dfe2b03aeb3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:11.323644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3b571-fc78-4d14-ac46-3dfe2b03aeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:11.324093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3b571-fc78-4d14-ac46-3dfe2b03aeb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:11.324916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3b571-fc78-4d14-ac46-3dfe2b03aeb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:11.325380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3b571-fc78-4d14-ac46-3dfe2b03aeb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:11.326923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3b571-fc78-4d14-ac46-3dfe2b03aeb3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:11.335779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 137/278] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:11.344998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3b571-fc78-4d14-ac46-3dfe2b03aeb3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:11.380006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410313-9142-4e34-afb5-23353e1f1246 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:11.389201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:11.422997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee70ca1-dccc-42ed-9cdd-28f9583aea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:11.423610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee70ca1-dccc-42ed-9cdd-28f9583aea79 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:11.423897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee70ca1-dccc-42ed-9cdd-28f9583aea79 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:11.424170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee70ca1-dccc-42ed-9cdd-28f9583aea79 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:11.424813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee70ca1-dccc-42ed-9cdd-28f9583aea79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:11.426277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee70ca1-dccc-42ed-9cdd-28f9583aea79 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:11.444297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3b571-fc78-4d14-ac46-3dfe2b03aeb3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:11.460987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 142/279] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:19:11 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:19:11.460987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee70ca1-dccc-42ed-9cdd-28f9583aea79 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:11.481516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9325723-b767-42d3-a631-826d671d6a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:11.482123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325723-b767-42d3-a631-826d671d6a24 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:11.482404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325723-b767-42d3-a631-826d671d6a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:11.482671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325723-b767-42d3-a631-826d671d6a24 None admin] PATH_INFO: `/v3/users/e26f8ace1bc2458fb86591af57beb88f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:11.492447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:11.501067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9325723-b767-42d3-a631-826d671d6a24 None admin] RBAC: Authorizing `identity:get_user(user_id=e26f8ace1bc2458fb86591af57beb88f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:11.502600 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9325723-b767-42d3-a631-826d671d6a24 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:11.504602 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 138/280] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:11 2022] GET /identity/v3/users/e26f8ace1bc2458fb86591af57beb88f => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:11.511004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9325723-b767-42d3-a631-826d671d6a24 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:11.606793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee70ca1-dccc-42ed-9cdd-28f9583aea79 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:11.645202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5ad8-b6d9-48da-8eb5-81297040c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:11.645859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5ad8-b6d9-48da-8eb5-81297040c5ec None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:11.646138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5ad8-b6d9-48da-8eb5-81297040c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:11.646412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5ad8-b6d9-48da-8eb5-81297040c5ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:11.651333 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9325723-b767-42d3-a631-826d671d6a24 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:11.658741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e5ad8-b6d9-48da-8eb5-81297040c5ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-0f7e5ad8-b6d9-48da-8eb5-81297040c5ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:11.664217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:11.665140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:11.665953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 143/281] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:11.666596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8286d-66e9-4c95-9443-913892def40d None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:11.667161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8286d-66e9-4c95-9443-913892def40d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:11.667161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8286d-66e9-4c95-9443-913892def40d None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:11.668477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 144/282] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:11.673777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1543-4de5-44ef-8db9-5df2a79f3aa6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:11.674066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1543-4de5-44ef-8db9-5df2a79f3aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:11.674343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1543-4de5-44ef-8db9-5df2a79f3aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:11.690107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ff050-1214-4618-b74d-8f6c26840afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:11.690868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ff050-1214-4618-b74d-8f6c26840afc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:11.691153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ff050-1214-4618-b74d-8f6c26840afc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:11.691419 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ff050-1214-4618-b74d-8f6c26840afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:11.692141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ff050-1214-4618-b74d-8f6c26840afc None admin] RBAC: Adding query filter params (role.id=d598e7097e2d496f971598b09965388a, user.id=e26f8ace1bc2458fb86591af57beb88f, scope.system=all) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:11.692444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ff050-1214-4618-b74d-8f6c26840afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:11.693895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ff050-1214-4618-b74d-8f6c26840afc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:11.694306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-30fa1543-4de5-44ef-8db9-5df2a79f3aa6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:11.695499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-30fa1543-4de5-44ef-8db9-5df2a79f3aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:11.700531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 139/283] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Sep 26 10:19:11 2022] GET /identity/v3/role_assignments?user.id=e26f8ace1bc2458fb86591af57beb88f&scope.system=all&role.id=d598e7097e2d496f971598b09965388a => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:11.701195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ff050-1214-4618-b74d-8f6c26840afc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:11.714492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:11.786560 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:11.799219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 145/284] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:11.842098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ff050-1214-4618-b74d-8f6c26840afc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:11.881679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2744-f19a-4521-a29e-807ea0a00231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:11.882299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2744-f19a-4521-a29e-807ea0a00231 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:11.882585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2744-f19a-4521-a29e-807ea0a00231 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:11.882847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2744-f19a-4521-a29e-807ea0a00231 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:11.883520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2744-f19a-4521-a29e-807ea0a00231 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:11.883819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2744-f19a-4521-a29e-807ea0a00231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:11.885334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2744-f19a-4521-a29e-807ea0a00231 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:11.894703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 140/285] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:11.900088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa1543-4de5-44ef-8db9-5df2a79f3aa6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:12.007494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa1543-4de5-44ef-8db9-5df2a79f3aa6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:12.047067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df05de-864a-4651-bbba-d1f32eca3d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:12.047625 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df05de-864a-4651-bbba-d1f32eca3d87 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:12.047903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df05de-864a-4651-bbba-d1f32eca3d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:12.048177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df05de-864a-4651-bbba-d1f32eca3d87 None admin] PATH_INFO: `/v3/users/b763e656205e40a19abb38112bb0b312` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:12.049335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df05de-864a-4651-bbba-d1f32eca3d87 None admin] RBAC: Authorizing `identity:get_user(user_id=b763e656205e40a19abb38112bb0b312)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:12.050783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df05de-864a-4651-bbba-d1f32eca3d87 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:12.052372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 146/286] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:11 2022] GET /identity/v3/users/b763e656205e40a19abb38112bb0b312 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:12.058052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2744-f19a-4521-a29e-807ea0a00231 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:12.096538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df05de-864a-4651-bbba-d1f32eca3d87 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:12.128446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:12.200026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2744-f19a-4521-a29e-807ea0a00231 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:12.248383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:12.268436 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2594b8d-0806-4355-bf79-ff1eb7844f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:12.270609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2594b8d-0806-4355-bf79-ff1eb7844f60 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:12.270889 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2594b8d-0806-4355-bf79-ff1eb7844f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:12.271163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2594b8d-0806-4355-bf79-ff1eb7844f60 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:12.274731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2594b8d-0806-4355-bf79-ff1eb7844f60 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:12.277433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2594b8d-0806-4355-bf79-ff1eb7844f60 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:12.282831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 141/287] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:12 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:12.287492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df05de-864a-4651-bbba-d1f32eca3d87 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:12.289928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2594b8d-0806-4355-bf79-ff1eb7844f60 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:12.326386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bc091-f997-4e19-9e15-c5ff9d73208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:12.327554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc091-f997-4e19-9e15-c5ff9d73208c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:12.327975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc091-f997-4e19-9e15-c5ff9d73208c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:12.328384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc091-f997-4e19-9e15-c5ff9d73208c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:12.341069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bc091-f997-4e19-9e15-c5ff9d73208c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-178bc091-f997-4e19-9e15-c5ff9d73208c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:12.346845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:12.347939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:12.348910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:12.350935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 147/288] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:12.358258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bc091-f997-4e19-9e15-c5ff9d73208c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:12.493146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2594b8d-0806-4355-bf79-ff1eb7844f60 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:12.505321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:12.543528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bc091-f997-4e19-9e15-c5ff9d73208c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:12.561805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec03ae-7a36-49fc-a315-48ec2bc83b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:12.562866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec03ae-7a36-49fc-a315-48ec2bc83b6d None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:12.563387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec03ae-7a36-49fc-a315-48ec2bc83b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:12.563870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec03ae-7a36-49fc-a315-48ec2bc83b6d None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9/users/b763e656205e40a19abb38112bb0b312/roles/0f69d1c2776d4f3c912de690451a4697` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:12.566065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec03ae-7a36-49fc-a315-48ec2bc83b6d None admin] RBAC: Authorizing `identity:create_grant(project_id=a101cbee2fb049a984083ce237c81fe9, user_id=b763e656205e40a19abb38112bb0b312, role_id=0f69d1c2776d4f3c912de690451a4697)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:12.568775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec03ae-7a36-49fc-a315-48ec2bc83b6d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:12.593082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 142/289] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:19:12 2022] PUT /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9/users/b763e656205e40a19abb38112bb0b312/roles/0f69d1c2776d4f3c912de690451a4697 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:12.615711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9681a9-d8c8-4443-98a2-2f88d448ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:12.616785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9681a9-d8c8-4443-98a2-2f88d448ae56 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:12.617365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9681a9-d8c8-4443-98a2-2f88d448ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:12.617836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9681a9-d8c8-4443-98a2-2f88d448ae56 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:12.618774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9681a9-d8c8-4443-98a2-2f88d448ae56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:12.619863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9681a9-d8c8-4443-98a2-2f88d448ae56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:12.621668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9681a9-d8c8-4443-98a2-2f88d448ae56 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:12.637216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 148/290] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:12.643348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec03ae-7a36-49fc-a315-48ec2bc83b6d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:12.714135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:12.778049 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec03ae-7a36-49fc-a315-48ec2bc83b6d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:12.819890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135f21e-e325-4902-9e15-d954cffb6f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:12.820883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135f21e-e325-4902-9e15-d954cffb6f93 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:12.821411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135f21e-e325-4902-9e15-d954cffb6f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:12.821890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135f21e-e325-4902-9e15-d954cffb6f93 None admin] PATH_INFO: `/v3/users/6649e68300574a7380212e60a37443aa` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:12.823342 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135f21e-e325-4902-9e15-d954cffb6f93 None admin] RBAC: Authorizing `identity:get_user(user_id=6649e68300574a7380212e60a37443aa)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:12.825090 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135f21e-e325-4902-9e15-d954cffb6f93 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:12.827301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 143/291] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:12 2022] GET /identity/v3/users/6649e68300574a7380212e60a37443aa => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:12.832494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9681a9-d8c8-4443-98a2-2f88d448ae56 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:12.954467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9681a9-d8c8-4443-98a2-2f88d448ae56 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:13.005245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bb20a-dc7c-4405-b26d-56c6e72bc36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:13.006203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bb20a-dc7c-4405-b26d-56c6e72bc36b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:13.006687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bb20a-dc7c-4405-b26d-56c6e72bc36b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:13.007148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bb20a-dc7c-4405-b26d-56c6e72bc36b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:13.024211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:13.096280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bb20a-dc7c-4405-b26d-56c6e72bc36b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:13.097758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bb20a-dc7c-4405-b26d-56c6e72bc36b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:13.227280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 149/292] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 10:19:13.233519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135f21e-e325-4902-9e15-d954cffb6f93 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:13.391705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135f21e-e325-4902-9e15-d954cffb6f93 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:13.416006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:13.438700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ef01f-bcad-41d2-a680-2258b10e9025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:13.439334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef01f-bcad-41d2-a680-2258b10e9025 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:13.439617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef01f-bcad-41d2-a680-2258b10e9025 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:13.439892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef01f-bcad-41d2-a680-2258b10e9025 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:13.441121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ef01f-bcad-41d2-a680-2258b10e9025 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:13.442564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ef01f-bcad-41d2-a680-2258b10e9025 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:13.444498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 144/293] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:13 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:13.450232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bb20a-dc7c-4405-b26d-56c6e72bc36b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:13.524478 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:13.592745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bb20a-dc7c-4405-b26d-56c6e72bc36b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:13.638540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f534b06-8035-401c-8fc6-9a11ee78a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:13.639150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f534b06-8035-401c-8fc6-9a11ee78a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:13.639431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f534b06-8035-401c-8fc6-9a11ee78a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:13.639703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f534b06-8035-401c-8fc6-9a11ee78a6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:13.640428 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f534b06-8035-401c-8fc6-9a11ee78a6bb None admin] RBAC: Adding query filter params (role.id=d598e7097e2d496f971598b09965388a, scope.project.id=a101cbee2fb049a984083ce237c81fe9, user.id=6649e68300574a7380212e60a37443aa) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:13.640736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f534b06-8035-401c-8fc6-9a11ee78a6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:13.642189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f534b06-8035-401c-8fc6-9a11ee78a6bb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:13.651563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 150/294] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:13 2022] GET /identity/v3/role_assignments?user.id=6649e68300574a7380212e60a37443aa&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=d598e7097e2d496f971598b09965388a => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:14.225560 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ae5ec-0136-4b4f-a45b-83147ca664cf None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:14.225951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ae5ec-0136-4b4f-a45b-83147ca664cf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:14.226126 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ae5ec-0136-4b4f-a45b-83147ca664cf None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:14.227873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 145/295] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:14.234000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818b7ff-d765-46de-9e33-3ba6e1d31225 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:14.234505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818b7ff-d765-46de-9e33-3ba6e1d31225 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:14.234612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818b7ff-d765-46de-9e33-3ba6e1d31225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:14.257342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4818b7ff-d765-46de-9e33-3ba6e1d31225 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:14.258565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4818b7ff-d765-46de-9e33-3ba6e1d31225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:14.338336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 151/296] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:14.359960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3ba3-dc0d-480a-9c51-57d3f420abbc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:14.360281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3ba3-dc0d-480a-9c51-57d3f420abbc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:14.360512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3ba3-dc0d-480a-9c51-57d3f420abbc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:14.362109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 146/297] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:14.368407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175008a-8041-44f5-8951-283dc1ef29de None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:14.368698 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175008a-8041-44f5-8951-283dc1ef29de None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:14.369971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175008a-8041-44f5-8951-283dc1ef29de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:14.387880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3175008a-8041-44f5-8951-283dc1ef29de None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:14.389083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3175008a-8041-44f5-8951-283dc1ef29de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:14.419931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:14.462006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 152/298] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:14.541745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f4462-4f71-4df4-ab18-501c3de66af2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:14.542660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f4462-4f71-4df4-ab18-501c3de66af2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:14.543132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f4462-4f71-4df4-ab18-501c3de66af2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:14.544886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 147/299] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:14.550161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe72f-31f2-46ab-ad19-6e3a1271efb0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:14.550694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe72f-31f2-46ab-ad19-6e3a1271efb0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:14.551170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe72f-31f2-46ab-ad19-6e3a1271efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:14.569977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-db6fe72f-31f2-46ab-ad19-6e3a1271efb0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:14.571460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-db6fe72f-31f2-46ab-ad19-6e3a1271efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:14.620322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f4462-4f71-4df4-ab18-501c3de66af2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:14.641457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 153/300] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:14.727868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f4462-4f71-4df4-ab18-501c3de66af2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:14.731835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fe72f-31f2-46ab-ad19-6e3a1271efb0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:14.765075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f7428-6944-4064-bd68-a7c7e892f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:14.765711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f7428-6944-4064-bd68-a7c7e892f80f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:14.765991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f7428-6944-4064-bd68-a7c7e892f80f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:14.766289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f7428-6944-4064-bd68-a7c7e892f80f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:14.777852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f7428-6944-4064-bd68-a7c7e892f80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-114f7428-6944-4064-bd68-a7c7e892f80f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:14.783584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:14.784446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:14.785622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 148/301] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:19:14.790875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f7428-6944-4064-bd68-a7c7e892f80f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:14.843446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:14.849453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:14.858554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fe72f-31f2-46ab-ad19-6e3a1271efb0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:14.903781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd51ff-cfee-4bab-b804-abe37f826e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:14.904044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f7428-6944-4064-bd68-a7c7e892f80f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:14.904660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd51ff-cfee-4bab-b804-abe37f826e5a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:14.905056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd51ff-cfee-4bab-b804-abe37f826e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:14.905424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd51ff-cfee-4bab-b804-abe37f826e5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:14.919237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd51ff-cfee-4bab-b804-abe37f826e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-17dd51ff-cfee-4bab-b804-abe37f826e5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:14.925040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:14.926090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:14.927065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:14.931016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 154/302] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:14.931967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd51ff-cfee-4bab-b804-abe37f826e5a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:14.948447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847e71a-dd5e-487e-bb1c-aa505208919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:14.949347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847e71a-dd5e-487e-bb1c-aa505208919b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:14.949781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847e71a-dd5e-487e-bb1c-aa505208919b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:14.950060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847e71a-dd5e-487e-bb1c-aa505208919b None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:14.950726 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847e71a-dd5e-487e-bb1c-aa505208919b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:14.951041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847e71a-dd5e-487e-bb1c-aa505208919b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:14.952412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847e71a-dd5e-487e-bb1c-aa505208919b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:14.961073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 149/303] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:14.961899 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847e71a-dd5e-487e-bb1c-aa505208919b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:15.048741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd51ff-cfee-4bab-b804-abe37f826e5a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:15.065238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847e71a-dd5e-487e-bb1c-aa505208919b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:15.074799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:15.084970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e7c97-22cc-4523-9ebd-ab1e9ca4c228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:15.085840 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e7c97-22cc-4523-9ebd-ab1e9ca4c228 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:15.086383 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e7c97-22cc-4523-9ebd-ab1e9ca4c228 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:15.086831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e7c97-22cc-4523-9ebd-ab1e9ca4c228 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:15.088322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e7c97-22cc-4523-9ebd-ab1e9ca4c228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:15.090242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e7c97-22cc-4523-9ebd-ab1e9ca4c228 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:15.092246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 155/304] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:15.093406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e7c97-22cc-4523-9ebd-ab1e9ca4c228 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:15.103022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0165f-f397-442d-92b3-f7781f050990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:15.104091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0165f-f397-442d-92b3-f7781f050990 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:15.104373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0165f-f397-442d-92b3-f7781f050990 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:15.104644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0165f-f397-442d-92b3-f7781f050990 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:15.105380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0165f-f397-442d-92b3-f7781f050990 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:15.105684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0165f-f397-442d-92b3-f7781f050990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:15.107108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0165f-f397-442d-92b3-f7781f050990 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:15.116491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 150/305] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:15.117397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0165f-f397-442d-92b3-f7781f050990 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:15.134441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:15.216406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e7c97-22cc-4523-9ebd-ab1e9ca4c228 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:15.222397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0165f-f397-442d-92b3-f7781f050990 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:15.249345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ab3d-8a7f-4332-bdf0-e2e80b69d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:15.249969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ab3d-8a7f-4332-bdf0-e2e80b69d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:15.250253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ab3d-8a7f-4332-bdf0-e2e80b69d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:15.250525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ab3d-8a7f-4332-bdf0-e2e80b69d1b1 None admin] PATH_INFO: `/v3/users/964c7ada528b4a8a9da9ab2bd2a66d74` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:15.255084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e2c95-5273-4f32-803f-9b326f21ceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:15.255679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e2c95-5273-4f32-803f-9b326f21ceaa None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:15.255955 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e2c95-5273-4f32-803f-9b326f21ceaa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:15.256221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e2c95-5273-4f32-803f-9b326f21ceaa None admin] PATH_INFO: `/v3/groups` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:15.256835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e2c95-5273-4f32-803f-9b326f21ceaa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:15.258298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e2c95-5273-4f32-803f-9b326f21ceaa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:15.263150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ab3d-8a7f-4332-bdf0-e2e80b69d1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=964c7ada528b4a8a9da9ab2bd2a66d74)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:15.264577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ab3d-8a7f-4332-bdf0-e2e80b69d1b1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:15.266224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 156/306] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:15 2022] GET /identity/v3/users/964c7ada528b4a8a9da9ab2bd2a66d74 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:15.266988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ab3d-8a7f-4332-bdf0-e2e80b69d1b1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:15.275661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 151/307] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Sep 26 10:19:15 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:19:15.277085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6412a-17d3-41a2-9845-088ed550e262 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:15.277376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6412a-17d3-41a2-9845-088ed550e262 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:15.277647 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6412a-17d3-41a2-9845-088ed550e262 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:15.278917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 152/308] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:15.279637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6412a-17d3-41a2-9845-088ed550e262 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:15.316283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:15.384187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:15.405163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6412a-17d3-41a2-9845-088ed550e262 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:15.406460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ab3d-8a7f-4332-bdf0-e2e80b69d1b1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:15.441111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9c18c-b3aa-44a2-a3f3-70406b50dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:15.441698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9c18c-b3aa-44a2-a3f3-70406b50dd5f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:15.441974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9c18c-b3aa-44a2-a3f3-70406b50dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:15.442266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9c18c-b3aa-44a2-a3f3-70406b50dd5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:15.442980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9c18c-b3aa-44a2-a3f3-70406b50dd5f None admin] RBAC: Adding query filter params (role.id=0f69d1c2776d4f3c912de690451a4697, user.id=964c7ada528b4a8a9da9ab2bd2a66d74, scope.system=all) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:15.443284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9c18c-b3aa-44a2-a3f3-70406b50dd5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:15.444699 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9c18c-b3aa-44a2-a3f3-70406b50dd5f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:15.447970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bca1ef-57ba-49ec-94ea-9fb03069d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:15.448611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bca1ef-57ba-49ec-94ea-9fb03069d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:15.448892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bca1ef-57ba-49ec-94ea-9fb03069d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:15.449192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bca1ef-57ba-49ec-94ea-9fb03069d0f1 None admin] PATH_INFO: `/v3/users/e26f8ace1bc2458fb86591af57beb88f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:15.450325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bca1ef-57ba-49ec-94ea-9fb03069d0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=e26f8ace1bc2458fb86591af57beb88f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:15.451184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 153/309] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Sep 26 10:19:15 2022] GET /identity/v3/role_assignments?user.id=964c7ada528b4a8a9da9ab2bd2a66d74&scope.system=all&role.id=0f69d1c2776d4f3c912de690451a4697 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:15.451738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bca1ef-57ba-49ec-94ea-9fb03069d0f1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:15.452478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac1ed5-c4af-4550-bea9-44138cc42813 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:15.452769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac1ed5-c4af-4550-bea9-44138cc42813 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:15.453066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac1ed5-c4af-4550-bea9-44138cc42813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:15.458116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 157/310] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:15 2022] GET /identity/v3/users/e26f8ace1bc2458fb86591af57beb88f => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:15.459248 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bca1ef-57ba-49ec-94ea-9fb03069d0f1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:15.472921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-edac1ed5-c4af-4550-bea9-44138cc42813 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:15.473465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-edac1ed5-c4af-4550-bea9-44138cc42813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:15.571393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 154/311] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:15.594351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bca1ef-57ba-49ec-94ea-9fb03069d0f1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:15.633863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6133e-e1a6-48e7-96f2-1001f15a588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:15.634894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6133e-e1a6-48e7-96f2-1001f15a588e None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:15.635390 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6133e-e1a6-48e7-96f2-1001f15a588e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:15.635889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6133e-e1a6-48e7-96f2-1001f15a588e None admin] PATH_INFO: `/v3/system/users/e26f8ace1bc2458fb86591af57beb88f/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:15.637547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6133e-e1a6-48e7-96f2-1001f15a588e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e26f8ace1bc2458fb86591af57beb88f, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:15.639137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6133e-e1a6-48e7-96f2-1001f15a588e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:15.652419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 158/312] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Sep 26 10:19:15 2022] PUT /identity/v3/system/users/e26f8ace1bc2458fb86591af57beb88f/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:15.855186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac1ed5-c4af-4550-bea9-44138cc42813 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:15.880109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:15.957999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac1ed5-c4af-4550-bea9-44138cc42813 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:15.993347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab48391-553e-4c15-b59c-6ad69cef449a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:15.994041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab48391-553e-4c15-b59c-6ad69cef449a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:15.994322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab48391-553e-4c15-b59c-6ad69cef449a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:15.994593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab48391-553e-4c15-b59c-6ad69cef449a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:16.004999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab48391-553e-4c15-b59c-6ad69cef449a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2ab48391-553e-4c15-b59c-6ad69cef449a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:16.010375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:16.011258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:16.012032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 155/313] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:16.018664 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6133e-e1a6-48e7-96f2-1001f15a588e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:16.035460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:16.123064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6133e-e1a6-48e7-96f2-1001f15a588e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:16.158875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d513bc7-f928-42d5-adfe-b1467c4b807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:16.159487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d513bc7-f928-42d5-adfe-b1467c4b807d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:16.159765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d513bc7-f928-42d5-adfe-b1467c4b807d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:16.160036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d513bc7-f928-42d5-adfe-b1467c4b807d None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:16.160703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d513bc7-f928-42d5-adfe-b1467c4b807d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:16.161038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d513bc7-f928-42d5-adfe-b1467c4b807d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:16.162404 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d513bc7-f928-42d5-adfe-b1467c4b807d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:16.171276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 159/314] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:16.176638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab48391-553e-4c15-b59c-6ad69cef449a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:16.264371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:16.281773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab48391-553e-4c15-b59c-6ad69cef449a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:16.318982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea74b52-2a9a-466b-a2b3-854498e9023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:16.319615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea74b52-2a9a-466b-a2b3-854498e9023e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:16.319897 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea74b52-2a9a-466b-a2b3-854498e9023e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:16.320171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea74b52-2a9a-466b-a2b3-854498e9023e None admin] PATH_INFO: `/v3/users/b763e656205e40a19abb38112bb0b312` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:16.321346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea74b52-2a9a-466b-a2b3-854498e9023e None admin] RBAC: Authorizing `identity:get_user(user_id=b763e656205e40a19abb38112bb0b312)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:16.322836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea74b52-2a9a-466b-a2b3-854498e9023e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:16.324405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 156/315] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:16 2022] GET /identity/v3/users/b763e656205e40a19abb38112bb0b312 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:16.330152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d513bc7-f928-42d5-adfe-b1467c4b807d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:16.421052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:16.451273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d513bc7-f928-42d5-adfe-b1467c4b807d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:16.490100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb48c3-507f-467d-b7b1-c1784a59e0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:16.490718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb48c3-507f-467d-b7b1-c1784a59e0fe None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:16.491003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb48c3-507f-467d-b7b1-c1784a59e0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:16.491278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb48c3-507f-467d-b7b1-c1784a59e0fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:16.561335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb48c3-507f-467d-b7b1-c1784a59e0fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:16.562714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb48c3-507f-467d-b7b1-c1784a59e0fe None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:16.643427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:16.668357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 160/316] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:16.673947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea74b52-2a9a-466b-a2b3-854498e9023e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:16.779568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea74b52-2a9a-466b-a2b3-854498e9023e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:16.815813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97bdbf-b3e9-4269-a36f-34586e6a1b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:16.816365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97bdbf-b3e9-4269-a36f-34586e6a1b05 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:16.816644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97bdbf-b3e9-4269-a36f-34586e6a1b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:16.816922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97bdbf-b3e9-4269-a36f-34586e6a1b05 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:16.818066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97bdbf-b3e9-4269-a36f-34586e6a1b05 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:16.819506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97bdbf-b3e9-4269-a36f-34586e6a1b05 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:16.821469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 157/317] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:16 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:16.827026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb48c3-507f-467d-b7b1-c1784a59e0fe None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:16.931035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb48c3-507f-467d-b7b1-c1784a59e0fe None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:16.966826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95995e2-7296-48b2-bf41-ee2cc259ca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:16.967436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95995e2-7296-48b2-bf41-ee2cc259ca01 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:16.967710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95995e2-7296-48b2-bf41-ee2cc259ca01 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:16.968037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95995e2-7296-48b2-bf41-ee2cc259ca01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:16.968808 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95995e2-7296-48b2-bf41-ee2cc259ca01 None admin] RBAC: Adding query filter params (role.id=0f69d1c2776d4f3c912de690451a4697, scope.project.id=a101cbee2fb049a984083ce237c81fe9, user.id=b763e656205e40a19abb38112bb0b312) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:16.969155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95995e2-7296-48b2-bf41-ee2cc259ca01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:16.970731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95995e2-7296-48b2-bf41-ee2cc259ca01 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:16.980697 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 161/318] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:16 2022] GET /identity/v3/role_assignments?user.id=b763e656205e40a19abb38112bb0b312&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=0f69d1c2776d4f3c912de690451a4697 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:17.628285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5f66-1ff3-456e-8484-2ba216a98b4b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:17.628494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5f66-1ff3-456e-8484-2ba216a98b4b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:17.628762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5f66-1ff3-456e-8484-2ba216a98b4b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:17.630247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 158/319] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:17.635921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2748f-5498-4c55-98b7-9271f738e212 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:17.636360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2748f-5498-4c55-98b7-9271f738e212 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:17.636537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2748f-5498-4c55-98b7-9271f738e212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:17.654648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c5f2748f-5498-4c55-98b7-9271f738e212 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:17.655388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a5f32-b7c5-4b84-90c5-47e122fea7eb None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:17.655669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a5f32-b7c5-4b84-90c5-47e122fea7eb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:17.655831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c5f2748f-5498-4c55-98b7-9271f738e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:17.655932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a5f32-b7c5-4b84-90c5-47e122fea7eb None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:17.657415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 159/320] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:19:17.662162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744185-d732-4ead-8f6e-c4c54afc7b38 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:17.662441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744185-d732-4ead-8f6e-c4c54afc7b38 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:17.662713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744185-d732-4ead-8f6e-c4c54afc7b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:17.680104 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1f744185-d732-4ead-8f6e-c4c54afc7b38 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:17.681806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1f744185-d732-4ead-8f6e-c4c54afc7b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:17.693835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:17.700916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:17.727868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 162/321] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:17.757646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 160/322] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:17.913385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2e82f-d5a6-4e4a-9804-0e55365060e8 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:17.913671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2e82f-d5a6-4e4a-9804-0e55365060e8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:17.913839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2e82f-d5a6-4e4a-9804-0e55365060e8 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:17.915316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 163/323] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:17.920326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ad078-cd38-4bd0-bb64-858e861214f7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:17.920613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ad078-cd38-4bd0-bb64-858e861214f7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:17.920884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ad078-cd38-4bd0-bb64-858e861214f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:17.940448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-026ad078-cd38-4bd0-bb64-858e861214f7 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:17.941654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-026ad078-cd38-4bd0-bb64-858e861214f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:18.000314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2e82f-d5a6-4e4a-9804-0e55365060e8 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:18.011677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 161/324] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:18.021224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ad078-cd38-4bd0-bb64-858e861214f7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:18.107227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:18.110967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2e82f-d5a6-4e4a-9804-0e55365060e8 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:18.126950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ad078-cd38-4bd0-bb64-858e861214f7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:18.145981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e6159-f979-40dd-a939-c8d81da50634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:18.146605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e6159-f979-40dd-a939-c8d81da50634 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:18.146881 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e6159-f979-40dd-a939-c8d81da50634 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:18.147150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e6159-f979-40dd-a939-c8d81da50634 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:18.148233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e6159-f979-40dd-a939-c8d81da50634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:18.149672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e6159-f979-40dd-a939-c8d81da50634 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:18.151764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 164/325] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:18.156842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e6159-f979-40dd-a939-c8d81da50634 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:18.162917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf4c49-a869-45e5-bd67-b68a8c61ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:18.163604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf4c49-a869-45e5-bd67-b68a8c61ac07 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:18.163828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf4c49-a869-45e5-bd67-b68a8c61ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:18.164109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf4c49-a869-45e5-bd67-b68a8c61ac07 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:18.175143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf4c49-a869-45e5-bd67-b68a8c61ac07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fbcf4c49-a869-45e5-bd67-b68a8c61ac07 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:18.180042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:18.180895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:18.183146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 162/326] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:19:18.186894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf4c49-a869-45e5-bd67-b68a8c61ac07 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:18.201915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:18.266167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e6159-f979-40dd-a939-c8d81da50634 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:18.292513 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf4c49-a869-45e5-bd67-b68a8c61ac07 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:18.302981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744cfe-ec07-4d26-bf4d-c39c5b7a072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:18.303752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744cfe-ec07-4d26-bf4d-c39c5b7a072a None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:18.304183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744cfe-ec07-4d26-bf4d-c39c5b7a072a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:18.304454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744cfe-ec07-4d26-bf4d-c39c5b7a072a None admin] PATH_INFO: `/v3/groups` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:18.305110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3744cfe-ec07-4d26-bf4d-c39c5b7a072a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:18.307146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3744cfe-ec07-4d26-bf4d-c39c5b7a072a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:18.322835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 165/327] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Sep 26 10:19:18 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:19:18.323973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744cfe-ec07-4d26-bf4d-c39c5b7a072a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:18.326616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd3169-5c7b-4edd-ac66-052a0b595e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:18.327901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3169-5c7b-4edd-ac66-052a0b595e23 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:18.327901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3169-5c7b-4edd-ac66-052a0b595e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:18.327901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3169-5c7b-4edd-ac66-052a0b595e23 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:18.328435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd3169-5c7b-4edd-ac66-052a0b595e23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:18.328738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd3169-5c7b-4edd-ac66-052a0b595e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:18.330221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd3169-5c7b-4edd-ac66-052a0b595e23 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:18.341789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 163/328] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:18.347658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd3169-5c7b-4edd-ac66-052a0b595e23 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:18.350652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:18.449385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:18.453595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744cfe-ec07-4d26-bf4d-c39c5b7a072a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:18.465571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd3169-5c7b-4edd-ac66-052a0b595e23 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:18.495980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159d9c0-7d45-47a6-955d-ab018ded3559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:18.496730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159d9c0-7d45-47a6-955d-ab018ded3559 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:18.497037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159d9c0-7d45-47a6-955d-ab018ded3559 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:18.497312 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159d9c0-7d45-47a6-955d-ab018ded3559 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:18.504491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cfc4f-d5e1-48a8-ad95-ad7e1206dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:18.505152 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cfc4f-d5e1-48a8-ad95-ad7e1206dc9b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:18.505439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cfc4f-d5e1-48a8-ad95-ad7e1206dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:18.505710 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cfc4f-d5e1-48a8-ad95-ad7e1206dc9b None admin] PATH_INFO: `/v3/users/964c7ada528b4a8a9da9ab2bd2a66d74` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:18.506883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cfc4f-d5e1-48a8-ad95-ad7e1206dc9b None admin] RBAC: Authorizing `identity:get_user(user_id=964c7ada528b4a8a9da9ab2bd2a66d74)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:18.508356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cfc4f-d5e1-48a8-ad95-ad7e1206dc9b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:18.510540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 164/329] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:18 2022] GET /identity/v3/users/964c7ada528b4a8a9da9ab2bd2a66d74 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:18.511297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159d9c0-7d45-47a6-955d-ab018ded3559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d159d9c0-7d45-47a6-955d-ab018ded3559 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:18.516415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:18.517486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:18.518260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:18.518830 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cfc4f-d5e1-48a8-ad95-ad7e1206dc9b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:18.518897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 166/330] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:18.523295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159d9c0-7d45-47a6-955d-ab018ded3559 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:18.602773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:18.640183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159d9c0-7d45-47a6-955d-ab018ded3559 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:18.643815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cfc4f-d5e1-48a8-ad95-ad7e1206dc9b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:18.684281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2c00-2bad-4b2b-ad9e-34dcca9b388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:18.685616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2c00-2bad-4b2b-ad9e-34dcca9b388a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:18.685616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2c00-2bad-4b2b-ad9e-34dcca9b388a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:18.685616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2c00-2bad-4b2b-ad9e-34dcca9b388a None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:18.686297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f2c00-2bad-4b2b-ad9e-34dcca9b388a None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:18.686596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f2c00-2bad-4b2b-ad9e-34dcca9b388a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:18.687113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce49ba-d1d9-4822-9047-f223033b4cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:18.687768 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce49ba-d1d9-4822-9047-f223033b4cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:18.688044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce49ba-d1d9-4822-9047-f223033b4cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:18.688135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f2c00-2bad-4b2b-ad9e-34dcca9b388a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:18.688315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce49ba-d1d9-4822-9047-f223033b4cb2 None admin] PATH_INFO: `/v3/system/users/964c7ada528b4a8a9da9ab2bd2a66d74/roles/0f69d1c2776d4f3c912de690451a4697` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:18.691469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce49ba-d1d9-4822-9047-f223033b4cb2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=964c7ada528b4a8a9da9ab2bd2a66d74, role_id=0f69d1c2776d4f3c912de690451a4697)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:18.692828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce49ba-d1d9-4822-9047-f223033b4cb2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:18.703286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 167/331] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:18.709659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2c00-2bad-4b2b-ad9e-34dcca9b388a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:18.710564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 165/332] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Sep 26 10:19:18 2022] PUT /identity/v3/system/users/964c7ada528b4a8a9da9ab2bd2a66d74/roles/0f69d1c2776d4f3c912de690451a4697 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:18.737918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:18.831143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2c00-2bad-4b2b-ad9e-34dcca9b388a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:18.876695 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d50eb-a72d-438f-b1da-febbe2d44a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:18.877814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d50eb-a72d-438f-b1da-febbe2d44a0b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:18.878295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d50eb-a72d-438f-b1da-febbe2d44a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:18.878753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d50eb-a72d-438f-b1da-febbe2d44a0b None admin] PATH_INFO: `/v3/users/e26f8ace1bc2458fb86591af57beb88f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:18.880791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d50eb-a72d-438f-b1da-febbe2d44a0b None admin] RBAC: Authorizing `identity:get_user(user_id=e26f8ace1bc2458fb86591af57beb88f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:18.883490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d50eb-a72d-438f-b1da-febbe2d44a0b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:18.886529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 168/333] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:18 2022] GET /identity/v3/users/e26f8ace1bc2458fb86591af57beb88f => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:18.892529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce49ba-d1d9-4822-9047-f223033b4cb2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:19.000691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce49ba-d1d9-4822-9047-f223033b4cb2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:19.036028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c85a0-297c-468a-90fb-4fe8c629ec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:19.036679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c85a0-297c-468a-90fb-4fe8c629ec95 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:19.036981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c85a0-297c-468a-90fb-4fe8c629ec95 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:19.037253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c85a0-297c-468a-90fb-4fe8c629ec95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:19.038019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c85a0-297c-468a-90fb-4fe8c629ec95 None admin] RBAC: Adding query filter params (role.id=d598e7097e2d496f971598b09965388a, user.id=e26f8ace1bc2458fb86591af57beb88f, scope.system=all) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:19.038380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c85a0-297c-468a-90fb-4fe8c629ec95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:19.039814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c85a0-297c-468a-90fb-4fe8c629ec95 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:19.041903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:19.055186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 166/334] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Sep 26 10:19:18 2022] GET /identity/v3/role_assignments?user.id=e26f8ace1bc2458fb86591af57beb88f&scope.system=all&role.id=d598e7097e2d496f971598b09965388a => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:21.026289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369572e5-412d-4ff2-9838-de3185dd3e15 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:21.026830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369572e5-412d-4ff2-9838-de3185dd3e15 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:21.026830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369572e5-412d-4ff2-9838-de3185dd3e15 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:21.028162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 169/335] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:21.034210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5036f-9956-4d20-b566-5689ef58c643 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:21.034632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5036f-9956-4d20-b566-5689ef58c643 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:21.034820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5036f-9956-4d20-b566-5689ef58c643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:21.058210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aba5036f-9956-4d20-b566-5689ef58c643 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:21.059453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aba5036f-9956-4d20-b566-5689ef58c643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:21.144516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 167/336] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:21.195474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbeea7-3f9f-4281-bdd1-cc35d6c73596 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:21.195803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbeea7-3f9f-4281-bdd1-cc35d6c73596 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:21.196034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbeea7-3f9f-4281-bdd1-cc35d6c73596 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:21.198303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 170/337] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:21.203528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d07f57-ddeb-4275-b394-0570a51ee76a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:21.203815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d07f57-ddeb-4275-b394-0570a51ee76a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:21.204094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d07f57-ddeb-4275-b394-0570a51ee76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:21.228805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-67d07f57-ddeb-4275-b394-0570a51ee76a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:21.230627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-67d07f57-ddeb-4275-b394-0570a51ee76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:21.315586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 168/338] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:21.456756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ed687-3ace-475d-a939-6faeda053724 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:21.457117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ed687-3ace-475d-a939-6faeda053724 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:21.457325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ed687-3ace-475d-a939-6faeda053724 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:21.458882 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 171/339] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:21.464841 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd390c-5a17-4195-877d-4e0c07c92afc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:21.465149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd390c-5a17-4195-877d-4e0c07c92afc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:21.465743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd390c-5a17-4195-877d-4e0c07c92afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:21.489909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f4cd390c-5a17-4195-877d-4e0c07c92afc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:21.491097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f4cd390c-5a17-4195-877d-4e0c07c92afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:21.541135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:21.563169 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 169/340] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:21.612085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ed687-3ace-475d-a939-6faeda053724 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:21.725687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:21.745371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ed687-3ace-475d-a939-6faeda053724 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:21.785776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56fd53-47c9-4ab4-9b0c-b1ce514b9b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:21.786750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56fd53-47c9-4ab4-9b0c-b1ce514b9b64 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:21.787224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56fd53-47c9-4ab4-9b0c-b1ce514b9b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:21.787721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56fd53-47c9-4ab4-9b0c-b1ce514b9b64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:21.795305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd390c-5a17-4195-877d-4e0c07c92afc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:21.800832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56fd53-47c9-4ab4-9b0c-b1ce514b9b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-fe56fd53-47c9-4ab4-9b0c-b1ce514b9b64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:21.804900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:21.805780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:21.806635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 172/341] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:19:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:21.814144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56fd53-47c9-4ab4-9b0c-b1ce514b9b64 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:21.926893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56fd53-47c9-4ab4-9b0c-b1ce514b9b64 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:21.968081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36574f1-9989-4e19-b394-0bb9c99ba96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:21.968925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36574f1-9989-4e19-b394-0bb9c99ba96d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:21.969387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36574f1-9989-4e19-b394-0bb9c99ba96d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:21.970080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36574f1-9989-4e19-b394-0bb9c99ba96d None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:21.970924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36574f1-9989-4e19-b394-0bb9c99ba96d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:21.971403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36574f1-9989-4e19-b394-0bb9c99ba96d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:21.972982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36574f1-9989-4e19-b394-0bb9c99ba96d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:21.983613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 173/342] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:21.985230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c929-eb01-44a3-a43f-07c13e7b0c65 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:21.985975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c929-eb01-44a3-a43f-07c13e7b0c65 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:21.986418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c929-eb01-44a3-a43f-07c13e7b0c65 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:21.988387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 174/343] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:21.994026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d310fd6-1480-480b-bb3d-f0095ff55c4d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:21.994502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d310fd6-1480-480b-bb3d-f0095ff55c4d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:21.994919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d310fd6-1480-480b-bb3d-f0095ff55c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:22.015362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7d310fd6-1480-480b-bb3d-f0095ff55c4d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:22.015680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd390c-5a17-4195-877d-4e0c07c92afc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:22.017103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7d310fd6-1480-480b-bb3d-f0095ff55c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:22.020506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:22.072743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0e48e-1af3-4b05-bcf3-4cae045454db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:22.074881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0e48e-1af3-4b05-bcf3-4cae045454db None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:22.074881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0e48e-1af3-4b05-bcf3-4cae045454db None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:22.075069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0e48e-1af3-4b05-bcf3-4cae045454db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:22.088370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0e48e-1af3-4b05-bcf3-4cae045454db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3da0e48e-1af3-4b05-bcf3-4cae045454db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:22.095885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:22.097023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:22.097880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 170/344] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:22.098645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0e48e-1af3-4b05-bcf3-4cae045454db None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:22.110023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 175/345] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:22.111023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d310fd6-1480-480b-bb3d-f0095ff55c4d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:22.154235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:22.226257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0e48e-1af3-4b05-bcf3-4cae045454db None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:22.234403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d310fd6-1480-480b-bb3d-f0095ff55c4d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:22.271901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fc54e-c75c-4ece-a7d6-d0281e4dec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:22.272127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fc54e-c75c-4ece-a7d6-d0281e4dec33 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:22.272324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fc54e-c75c-4ece-a7d6-d0281e4dec33 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:22.272527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fc54e-c75c-4ece-a7d6-d0281e4dec33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:22.282682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604bd4-131c-4cd4-b89f-e578a897538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:22.283622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604bd4-131c-4cd4-b89f-e578a897538c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:22.284076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604bd4-131c-4cd4-b89f-e578a897538c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:22.284972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604bd4-131c-4cd4-b89f-e578a897538c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:22.294215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:22.297967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a604bd4-131c-4cd4-b89f-e578a897538c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-0a604bd4-131c-4cd4-b89f-e578a897538c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:22.307291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:22.308197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 10:19:22.309076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:22.315280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 176/346] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:22.315280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604bd4-131c-4cd4-b89f-e578a897538c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:22.362225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fc54e-c75c-4ece-a7d6-d0281e4dec33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:22.364064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fc54e-c75c-4ece-a7d6-d0281e4dec33 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:22.411458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:22.472000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 171/347] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:22.472928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fc54e-c75c-4ece-a7d6-d0281e4dec33 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:22.521395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604bd4-131c-4cd4-b89f-e578a897538c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:22.561452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a1aa8-ab49-48cc-8859-52f8b2f268c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:22.562499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a1aa8-ab49-48cc-8859-52f8b2f268c6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:22.562784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a1aa8-ab49-48cc-8859-52f8b2f268c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:22.563065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a1aa8-ab49-48cc-8859-52f8b2f268c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:22.563735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a1aa8-ab49-48cc-8859-52f8b2f268c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:22.564097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a1aa8-ab49-48cc-8859-52f8b2f268c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:22.565507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a1aa8-ab49-48cc-8859-52f8b2f268c6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:22.576220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 177/348] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:22.577518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a1aa8-ab49-48cc-8859-52f8b2f268c6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:22.657864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fc54e-c75c-4ece-a7d6-d0281e4dec33 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:22.672905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:22.701525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4dda0-8888-4cd1-ad97-1cf7e3335e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:22.702140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4dda0-8888-4cd1-ad97-1cf7e3335e46 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:22.702422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4dda0-8888-4cd1-ad97-1cf7e3335e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:22.702696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4dda0-8888-4cd1-ad97-1cf7e3335e46 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:22.703366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4dda0-8888-4cd1-ad97-1cf7e3335e46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:22.703674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4dda0-8888-4cd1-ad97-1cf7e3335e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:22.706335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4dda0-8888-4cd1-ad97-1cf7e3335e46 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:22.712171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a1aa8-ab49-48cc-8859-52f8b2f268c6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:22.715305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 172/349] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:22.718116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4dda0-8888-4cd1-ad97-1cf7e3335e46 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:22.721884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:22.753921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882e11a-1c7c-48ba-a76e-9e90ed08c6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:22.754560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e11a-1c7c-48ba-a76e-9e90ed08c6bc None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:22.754981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e11a-1c7c-48ba-a76e-9e90ed08c6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:22.755245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e11a-1c7c-48ba-a76e-9e90ed08c6bc None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:22.756362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882e11a-1c7c-48ba-a76e-9e90ed08c6bc None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:22.757829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882e11a-1c7c-48ba-a76e-9e90ed08c6bc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:22.760151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 178/350] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:22 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:22.760817 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882e11a-1c7c-48ba-a76e-9e90ed08c6bc None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:22.855091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4dda0-8888-4cd1-ad97-1cf7e3335e46 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:22.881446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882e11a-1c7c-48ba-a76e-9e90ed08c6bc None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:22.898430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20842d65-d345-4bf9-952f-1def63097610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:22.899047 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20842d65-d345-4bf9-952f-1def63097610 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:22.899330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20842d65-d345-4bf9-952f-1def63097610 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:22.899601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20842d65-d345-4bf9-952f-1def63097610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:22.913815 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:22.920252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112246ad-78ea-449d-885a-41ff464e4707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:22.921266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112246ad-78ea-449d-885a-41ff464e4707 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:22.921916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112246ad-78ea-449d-885a-41ff464e4707 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:22.922283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112246ad-78ea-449d-885a-41ff464e4707 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:22.933904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112246ad-78ea-449d-885a-41ff464e4707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-112246ad-78ea-449d-885a-41ff464e4707 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:22.940220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:22.941125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:22.941913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 179/351] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:22.945122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112246ad-78ea-449d-885a-41ff464e4707 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:22.987447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20842d65-d345-4bf9-952f-1def63097610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:22.989128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20842d65-d345-4bf9-952f-1def63097610 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:22.994386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:23.070310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112246ad-78ea-449d-885a-41ff464e4707 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:23.112257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 173/352] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:23.113465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8c178-73e4-416a-b62e-a1b99970b9ef None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:23.113749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8c178-73e4-416a-b62e-a1b99970b9ef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:23.114023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8c178-73e4-416a-b62e-a1b99970b9ef None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:23.119921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 174/353] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:23.119921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8c178-73e4-416a-b62e-a1b99970b9ef None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:23.122867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29448-bf36-4290-ac91-1bdebc693f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:23.123589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29448-bf36-4290-ac91-1bdebc693f50 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:23.123941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29448-bf36-4290-ac91-1bdebc693f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:23.124284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29448-bf36-4290-ac91-1bdebc693f50 None admin] PATH_INFO: `/v3/users/964c7ada528b4a8a9da9ab2bd2a66d74` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:23.125548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e29448-bf36-4290-ac91-1bdebc693f50 None admin] RBAC: Authorizing `identity:get_user(user_id=964c7ada528b4a8a9da9ab2bd2a66d74)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:23.127075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e29448-bf36-4290-ac91-1bdebc693f50 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:23.128853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 180/354] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:19:22 2022] GET /identity/v3/users/964c7ada528b4a8a9da9ab2bd2a66d74 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:23.129574 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29448-bf36-4290-ac91-1bdebc693f50 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:23.202786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:23.245696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8c178-73e4-416a-b62e-a1b99970b9ef None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:23.250624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:23.258078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29448-bf36-4290-ac91-1bdebc693f50 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:23.297795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd1991-000b-4b7d-b194-99a45adfa779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:23.298435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd1991-000b-4b7d-b194-99a45adfa779 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:23.298709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd1991-000b-4b7d-b194-99a45adfa779 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:23.298984 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd1991-000b-4b7d-b194-99a45adfa779 None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:23.309104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6010dc-9bbe-4085-bed8-3836f8fe6d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:23.309721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6010dc-9bbe-4085-bed8-3836f8fe6d62 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:23.310065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6010dc-9bbe-4085-bed8-3836f8fe6d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:23.310184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd1991-000b-4b7d-b194-99a45adfa779 None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:23.310260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6010dc-9bbe-4085-bed8-3836f8fe6d62 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:23.310927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6010dc-9bbe-4085-bed8-3836f8fe6d62 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:23.311229 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6010dc-9bbe-4085-bed8-3836f8fe6d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:23.311756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd1991-000b-4b7d-b194-99a45adfa779 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:23.312577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6010dc-9bbe-4085-bed8-3836f8fe6d62 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:23.313489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 175/355] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:23 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:23.314485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd1991-000b-4b7d-b194-99a45adfa779 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:23.322647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 181/356] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:23.328243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9a19-b5f3-4ed0-ac4f-46f4367c5a89 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:23.328534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9a19-b5f3-4ed0-ac4f-46f4367c5a89 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:23.328828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9a19-b5f3-4ed0-ac4f-46f4367c5a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:23.350072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-725f9a19-b5f3-4ed0-ac4f-46f4367c5a89 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:23.351122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-725f9a19-b5f3-4ed0-ac4f-46f4367c5a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:23.435184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd1991-000b-4b7d-b194-99a45adfa779 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:23.439079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 182/357] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:23.441544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f9a19-b5f3-4ed0-ac4f-46f4367c5a89 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:23.477063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029c8c4-ff10-4efd-ae92-65a937ee30db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:23.478555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029c8c4-ff10-4efd-ae92-65a937ee30db None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:23.479033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029c8c4-ff10-4efd-ae92-65a937ee30db None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:23.479637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029c8c4-ff10-4efd-ae92-65a937ee30db None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:23.481182 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029c8c4-ff10-4efd-ae92-65a937ee30db None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:23.482800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029c8c4-ff10-4efd-ae92-65a937ee30db None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:23.489105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 176/358] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:23 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:23.490227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029c8c4-ff10-4efd-ae92-65a937ee30db None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:23.498322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:23.532262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:23.559331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f9a19-b5f3-4ed0-ac4f-46f4367c5a89 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:23.598165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac88101-4025-48a6-8284-bc05c78de39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:23.598802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac88101-4025-48a6-8284-bc05c78de39e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:23.599476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac88101-4025-48a6-8284-bc05c78de39e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:23.599476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac88101-4025-48a6-8284-bc05c78de39e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:23.600186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac88101-4025-48a6-8284-bc05c78de39e None admin] RBAC: Adding query filter params (role.id=0f69d1c2776d4f3c912de690451a4697, user.id=964c7ada528b4a8a9da9ab2bd2a66d74, scope.system=all) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:23.600495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac88101-4025-48a6-8284-bc05c78de39e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:23.601955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac88101-4025-48a6-8284-bc05c78de39e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:23.612566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029c8c4-ff10-4efd-ae92-65a937ee30db None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:23.617046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 183/359] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Sep 26 10:19:23 2022] GET /identity/v3/role_assignments?user.id=964c7ada528b4a8a9da9ab2bd2a66d74&scope.system=all&role.id=0f69d1c2776d4f3c912de690451a4697 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:23.617046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac88101-4025-48a6-8284-bc05c78de39e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:23.657757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341beb-960b-4929-b750-a1d93399c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:23.659045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341beb-960b-4929-b750-a1d93399c4ea None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:23.659579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341beb-960b-4929-b750-a1d93399c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:23.660047 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d341beb-960b-4929-b750-a1d93399c4ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:23.661104 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d341beb-960b-4929-b750-a1d93399c4ea None admin] RBAC: Adding query filter params (group.id=44784d10306643b88431c1d682f45398, role.id=d742575a6b40459fbb329defa3b642c5, scope.project.id=353afc27991d4d4bbe4860b6b70da681) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:23.661626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d341beb-960b-4929-b750-a1d93399c4ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:23.663371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d341beb-960b-4929-b750-a1d93399c4ea None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:23.670221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 177/360] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 10:19:23 2022] GET /identity/v3/role_assignments?group.id=44784d10306643b88431c1d682f45398&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=d742575a6b40459fbb329defa3b642c5 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:23.671424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341beb-960b-4929-b750-a1d93399c4ea None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:23.786598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac88101-4025-48a6-8284-bc05c78de39e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:23.798458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:23.828741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568df19-ab4c-4a44-b55b-afc01eebe494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:23.829436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568df19-ab4c-4a44-b55b-afc01eebe494 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:23.829713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568df19-ab4c-4a44-b55b-afc01eebe494 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:23.829980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568df19-ab4c-4a44-b55b-afc01eebe494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:23.840675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d341beb-960b-4929-b750-a1d93399c4ea None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:23.846432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:23.919002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568df19-ab4c-4a44-b55b-afc01eebe494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:23.920409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568df19-ab4c-4a44-b55b-afc01eebe494 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:23.933718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29be90-833f-425f-9615-dff0406cc4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:23.934384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29be90-833f-425f-9615-dff0406cc4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:23.934672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29be90-833f-425f-9615-dff0406cc4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:23.934949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29be90-833f-425f-9615-dff0406cc4e0 None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:23.941815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29be90-833f-425f-9615-dff0406cc4e0 None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:23.943301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29be90-833f-425f-9615-dff0406cc4e0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:23.945167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 178/361] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:23 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:23.945775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29be90-833f-425f-9615-dff0406cc4e0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:24.047494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 184/362] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:24.049045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568df19-ab4c-4a44-b55b-afc01eebe494 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:24.061426 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:24.081809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29be90-833f-425f-9615-dff0406cc4e0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:24.126913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6b3f0-f91e-4c66-8fda-2cd2525d42bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:24.127573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6b3f0-f91e-4c66-8fda-2cd2525d42bf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:24.127848 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6b3f0-f91e-4c66-8fda-2cd2525d42bf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:24.128241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6b3f0-f91e-4c66-8fda-2cd2525d42bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:24.140722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6b3f0-f91e-4c66-8fda-2cd2525d42bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-21e6b3f0-f91e-4c66-8fda-2cd2525d42bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:24.147885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:24.149036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:24.150187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:24.152760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 179/363] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:19:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:24.154696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28db668-68bb-4f96-a90e-76841290ed0b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:24.155153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28db668-68bb-4f96-a90e-76841290ed0b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:24.155576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28db668-68bb-4f96-a90e-76841290ed0b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:24.157907 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 180/364] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:24.158745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28db668-68bb-4f96-a90e-76841290ed0b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:24.181603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568df19-ab4c-4a44-b55b-afc01eebe494 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:24.196534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:24.226182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df1a08-2293-4b73-b6e9-88ed7c6a13f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:24.226182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df1a08-2293-4b73-b6e9-88ed7c6a13f9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:24.226480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df1a08-2293-4b73-b6e9-88ed7c6a13f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:24.227314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df1a08-2293-4b73-b6e9-88ed7c6a13f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:24.228823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df1a08-2293-4b73-b6e9-88ed7c6a13f9 None admin] RBAC: Adding query filter params (group.id=44784d10306643b88431c1d682f45398, role.id=d598e7097e2d496f971598b09965388a, scope.project.id=353afc27991d4d4bbe4860b6b70da681) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:24.228935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df1a08-2293-4b73-b6e9-88ed7c6a13f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:24.230365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df1a08-2293-4b73-b6e9-88ed7c6a13f9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:24.236467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 185/365] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 10:19:24 2022] GET /identity/v3/role_assignments?group.id=44784d10306643b88431c1d682f45398&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=d598e7097e2d496f971598b09965388a => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:24.238490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df1a08-2293-4b73-b6e9-88ed7c6a13f9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:24.303302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28db668-68bb-4f96-a90e-76841290ed0b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:24.326917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:24.352062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e443b10-efa5-447e-ad4b-508eb9747d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:24.353212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443b10-efa5-447e-ad4b-508eb9747d7d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:24.353725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443b10-efa5-447e-ad4b-508eb9747d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:24.354216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443b10-efa5-447e-ad4b-508eb9747d7d None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:24.355658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e443b10-efa5-447e-ad4b-508eb9747d7d None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:24.357452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e443b10-efa5-447e-ad4b-508eb9747d7d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:24.359409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 181/366] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:24 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:24.360907 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882ef7b-29ea-4faa-a1e9-3511ea3ed8f2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:24.361431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882ef7b-29ea-4faa-a1e9-3511ea3ed8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:24.361916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882ef7b-29ea-4faa-a1e9-3511ea3ed8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:24.362968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df1a08-2293-4b73-b6e9-88ed7c6a13f9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:24.386507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1882ef7b-29ea-4faa-a1e9-3511ea3ed8f2 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:24.388191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1882ef7b-29ea-4faa-a1e9-3511ea3ed8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:24.403740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4e3d0-29e1-4579-a855-96571108ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:24.404386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4e3d0-29e1-4579-a855-96571108ca06 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:24.404665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4e3d0-29e1-4579-a855-96571108ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:24.404935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4e3d0-29e1-4579-a855-96571108ca06 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:24.404935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4e3d0-29e1-4579-a855-96571108ca06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:24.404935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4e3d0-29e1-4579-a855-96571108ca06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:24.407306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4e3d0-29e1-4579-a855-96571108ca06 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:24.416655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 186/367] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:24.417265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4e3d0-29e1-4579-a855-96571108ca06 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:24.477148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 182/368] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:24.483068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882ef7b-29ea-4faa-a1e9-3511ea3ed8f2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:24.525882 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:24.554706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4e3d0-29e1-4579-a855-96571108ca06 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:24.630258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32147c4b-ed74-45a3-9f0c-bec466cb2e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:24.630903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32147c4b-ed74-45a3-9f0c-bec466cb2e27 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:24.631183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32147c4b-ed74-45a3-9f0c-bec466cb2e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:24.631451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32147c4b-ed74-45a3-9f0c-bec466cb2e27 None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:24.633394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32147c4b-ed74-45a3-9f0c-bec466cb2e27 None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:24.634942 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32147c4b-ed74-45a3-9f0c-bec466cb2e27 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:24.639144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 187/369] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:24 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:24.643752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32147c4b-ed74-45a3-9f0c-bec466cb2e27 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:24.647514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:24.670917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882ef7b-29ea-4faa-a1e9-3511ea3ed8f2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:24.744134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f4847-2c16-4e0c-9090-c3799a0e1840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:24.744670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4847-2c16-4e0c-9090-c3799a0e1840 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:24.744961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4847-2c16-4e0c-9090-c3799a0e1840 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:24.745247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4847-2c16-4e0c-9090-c3799a0e1840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:24.812782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32147c4b-ed74-45a3-9f0c-bec466cb2e27 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:24.855918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04b451-05e9-486b-b39f-ab016f3e7a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:24.856546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04b451-05e9-486b-b39f-ab016f3e7a36 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:24.856810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04b451-05e9-486b-b39f-ab016f3e7a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:24.857117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04b451-05e9-486b-b39f-ab016f3e7a36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:24.857844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04b451-05e9-486b-b39f-ab016f3e7a36 None admin] RBAC: Adding query filter params (group.id=44784d10306643b88431c1d682f45398, role.id=d598e7097e2d496f971598b09965388a, scope.project.id=a101cbee2fb049a984083ce237c81fe9) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:24.858154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04b451-05e9-486b-b39f-ab016f3e7a36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:24.859581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04b451-05e9-486b-b39f-ab016f3e7a36 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:24.861652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f4847-2c16-4e0c-9090-c3799a0e1840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:24.863430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f4847-2c16-4e0c-9090-c3799a0e1840 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:24.865793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 188/370] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 10:19:24 2022] GET /identity/v3/role_assignments?group.id=44784d10306643b88431c1d682f45398&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=d598e7097e2d496f971598b09965388a => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:24.867393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04b451-05e9-486b-b39f-ab016f3e7a36 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:24.895321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:24.954887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:24.998266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 183/371] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:24.999962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04b451-05e9-486b-b39f-ab016f3e7a36 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:25.003930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f4847-2c16-4e0c-9090-c3799a0e1840 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:25.043363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5acf2a-0be0-4a15-b0c0-02d46bd6a9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:25.044520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5acf2a-0be0-4a15-b0c0-02d46bd6a9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:25.045056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5acf2a-0be0-4a15-b0c0-02d46bd6a9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:25.045554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5acf2a-0be0-4a15-b0c0-02d46bd6a9c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:25.058883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5acf2a-0be0-4a15-b0c0-02d46bd6a9c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ef5acf2a-0be0-4a15-b0c0-02d46bd6a9c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:25.065264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:25.066184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:19:25.066988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:25.069785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 189/372] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:25.076399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5acf2a-0be0-4a15-b0c0-02d46bd6a9c7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:25.182791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f4847-2c16-4e0c-9090-c3799a0e1840 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:25.206921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5acf2a-0be0-4a15-b0c0-02d46bd6a9c7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:25.237643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:25.251001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:25.255021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128caef-349e-459a-81ef-e8fba7ff4fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:25.255688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128caef-349e-459a-81ef-e8fba7ff4fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:25.255969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128caef-349e-459a-81ef-e8fba7ff4fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:25.256242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128caef-349e-459a-81ef-e8fba7ff4fd6 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:25.257555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128caef-349e-459a-81ef-e8fba7ff4fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:25.259043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128caef-349e-459a-81ef-e8fba7ff4fd6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:25.263230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 184/373] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:25 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:25.266236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128caef-349e-459a-81ef-e8fba7ff4fd6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:25.270985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb9285-a21c-45fc-b323-987b3c596aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:25.271598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb9285-a21c-45fc-b323-987b3c596aba None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:25.271878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb9285-a21c-45fc-b323-987b3c596aba None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:25.272148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb9285-a21c-45fc-b323-987b3c596aba None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:25.272816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb9285-a21c-45fc-b323-987b3c596aba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:25.273144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb9285-a21c-45fc-b323-987b3c596aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:25.274524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb9285-a21c-45fc-b323-987b3c596aba None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:25.293932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 190/374] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:25.298212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb9285-a21c-45fc-b323-987b3c596aba None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:25.401069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128caef-349e-459a-81ef-e8fba7ff4fd6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:25.441433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814ae4-bbab-4f27-b71c-89f49ce8f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:25.442383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814ae4-bbab-4f27-b71c-89f49ce8f80e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:25.442669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814ae4-bbab-4f27-b71c-89f49ce8f80e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:25.442947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814ae4-bbab-4f27-b71c-89f49ce8f80e None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:25.444615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74814ae4-bbab-4f27-b71c-89f49ce8f80e None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:25.446109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74814ae4-bbab-4f27-b71c-89f49ce8f80e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:25.448556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 185/375] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:25 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:25.456115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814ae4-bbab-4f27-b71c-89f49ce8f80e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:25.517086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb9285-a21c-45fc-b323-987b3c596aba None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:25.554683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386af56-b653-43c9-8e14-ac02741ff36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:25.555355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386af56-b653-43c9-8e14-ac02741ff36c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:25.555482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:25.555628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386af56-b653-43c9-8e14-ac02741ff36c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:25.555958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386af56-b653-43c9-8e14-ac02741ff36c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:25.599441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814ae4-bbab-4f27-b71c-89f49ce8f80e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:25.623581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:25.639607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386af56-b653-43c9-8e14-ac02741ff36c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:25.641123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386af56-b653-43c9-8e14-ac02741ff36c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:25.647768 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc266d-2191-48ab-9356-60824a16d801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:25.648562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc266d-2191-48ab-9356-60824a16d801 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:25.649038 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc266d-2191-48ab-9356-60824a16d801 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:25.649462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc266d-2191-48ab-9356-60824a16d801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:25.651114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc266d-2191-48ab-9356-60824a16d801 None admin] RBAC: Adding query filter params (group.id=44784d10306643b88431c1d682f45398, role.id=d742575a6b40459fbb329defa3b642c5, scope.project.id=a101cbee2fb049a984083ce237c81fe9) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:25.651569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc266d-2191-48ab-9356-60824a16d801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:25.653628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc266d-2191-48ab-9356-60824a16d801 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:25.661533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 186/376] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 10:19:25 2022] GET /identity/v3/role_assignments?group.id=44784d10306643b88431c1d682f45398&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=d742575a6b40459fbb329defa3b642c5 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:25.765523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 191/377] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:25.771392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc266d-2191-48ab-9356-60824a16d801 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:25.913485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc266d-2191-48ab-9356-60824a16d801 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:25.948673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:25.957990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c1f57-26a8-4273-aa88-b2e8296214a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:25.958692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c1f57-26a8-4273-aa88-b2e8296214a7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:25.958969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c1f57-26a8-4273-aa88-b2e8296214a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:25.959287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c1f57-26a8-4273-aa88-b2e8296214a7 None admin] PATH_INFO: `/v3/projects/5634981824594276a0bd3022cd78b5df` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:25.960488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c1f57-26a8-4273-aa88-b2e8296214a7 None admin] RBAC: Authorizing `identity:get_project(project_id=5634981824594276a0bd3022cd78b5df)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:25.962055 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c1f57-26a8-4273-aa88-b2e8296214a7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:25.964547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 187/378] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:25 2022] GET /identity/v3/projects/5634981824594276a0bd3022cd78b5df => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:25.969720 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386af56-b653-43c9-8e14-ac02741ff36c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:26.065005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:26.078573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386af56-b653-43c9-8e14-ac02741ff36c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:26.114190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab15153-601a-4821-b675-1572567fcb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:26.114822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15153-601a-4821-b675-1572567fcb5e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:26.115100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15153-601a-4821-b675-1572567fcb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:26.115369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15153-601a-4821-b675-1572567fcb5e None admin] PATH_INFO: `/v3/groups/13758925a2204b2984a708aa65d16b93` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:26.123738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab15153-601a-4821-b675-1572567fcb5e None admin] RBAC: Authorizing `identity:get_group(group_id=13758925a2204b2984a708aa65d16b93)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:26.125331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab15153-601a-4821-b675-1572567fcb5e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:26.127322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 192/379] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:25 2022] GET /identity/v3/groups/13758925a2204b2984a708aa65d16b93 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:26.132730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c1f57-26a8-4273-aa88-b2e8296214a7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:26.239143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c1f57-26a8-4273-aa88-b2e8296214a7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:26.273383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177af5bd-9689-484e-869d-6659dfd45cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:26.274037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af5bd-9689-484e-869d-6659dfd45cfa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:26.274316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af5bd-9689-484e-869d-6659dfd45cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:26.274584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af5bd-9689-484e-869d-6659dfd45cfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:26.275614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177af5bd-9689-484e-869d-6659dfd45cfa None admin] RBAC: Adding query filter params (group.id=13758925a2204b2984a708aa65d16b93, role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=5634981824594276a0bd3022cd78b5df) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:26.275920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177af5bd-9689-484e-869d-6659dfd45cfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:26.277356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177af5bd-9689-484e-869d-6659dfd45cfa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:26.283264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 188/380] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 10:19:26 2022] GET /identity/v3/role_assignments?group.id=13758925a2204b2984a708aa65d16b93&scope.project.id=5634981824594276a0bd3022cd78b5df&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:26.609785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757706a7-79de-4060-8033-6a74c6683a50 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:26.610298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757706a7-79de-4060-8033-6a74c6683a50 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:26.610600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757706a7-79de-4060-8033-6a74c6683a50 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:26.612332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 193/381] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:26.617469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb5ab2-8b5b-43e7-8197-a8a33256cd77 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:26.617708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb5ab2-8b5b-43e7-8197-a8a33256cd77 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:26.617957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb5ab2-8b5b-43e7-8197-a8a33256cd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:26.637914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-86eb5ab2-8b5b-43e7-8197-a8a33256cd77 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:26.639098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-86eb5ab2-8b5b-43e7-8197-a8a33256cd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:26.704426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:26.727768 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 189/382] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:27.045194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15385-a3ec-4061-90db-7d2f95288dab None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:27.045796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15385-a3ec-4061-90db-7d2f95288dab None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:27.046286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15385-a3ec-4061-90db-7d2f95288dab None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:27.048067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 194/383] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:27.053644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25286be5-a544-4c27-aff9-612c0cf8f33a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:27.054207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25286be5-a544-4c27-aff9-612c0cf8f33a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:27.054681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25286be5-a544-4c27-aff9-612c0cf8f33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:27.076908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-25286be5-a544-4c27-aff9-612c0cf8f33a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:27.078474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-25286be5-a544-4c27-aff9-612c0cf8f33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:27.158136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 190/384] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:27.266398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f15385-a3ec-4061-90db-7d2f95288dab None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:27.405631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f15385-a3ec-4061-90db-7d2f95288dab None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:27.446241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25286be5-a544-4c27-aff9-612c0cf8f33a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:27.447637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b380e-6d11-4c55-ba60-b789e24aa4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:27.448285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b380e-6d11-4c55-ba60-b789e24aa4ed None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:27.448568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b380e-6d11-4c55-ba60-b789e24aa4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:27.448842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b380e-6d11-4c55-ba60-b789e24aa4ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:27.474153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b380e-6d11-4c55-ba60-b789e24aa4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-017b380e-6d11-4c55-ba60-b789e24aa4ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:27.479877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:27.480906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:27.481730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 195/385] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:19:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:27.488693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b380e-6d11-4c55-ba60-b789e24aa4ed None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:27.519110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:27.631171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b380e-6d11-4c55-ba60-b789e24aa4ed None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:27.640675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25286be5-a544-4c27-aff9-612c0cf8f33a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:27.669613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576103-82d4-40da-89f8-053289901448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:27.670610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576103-82d4-40da-89f8-053289901448 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:27.671113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576103-82d4-40da-89f8-053289901448 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:27.671585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576103-82d4-40da-89f8-053289901448 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:27.672554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576103-82d4-40da-89f8-053289901448 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:27.673093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576103-82d4-40da-89f8-053289901448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:27.674666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576103-82d4-40da-89f8-053289901448 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:27.680892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:27.687337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 196/386] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:27.693812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576103-82d4-40da-89f8-053289901448 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:27.713257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fc360-16f6-48ea-ab61-04cc2b3edf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:27.715359 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fc360-16f6-48ea-ab61-04cc2b3edf74 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:27.716412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fc360-16f6-48ea-ab61-04cc2b3edf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:27.716978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fc360-16f6-48ea-ab61-04cc2b3edf74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:27.741584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fc360-16f6-48ea-ab61-04cc2b3edf74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7d9fc360-16f6-48ea-ab61-04cc2b3edf74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:27.746545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:27.747441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:27.748205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 191/387] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:27.762547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fc360-16f6-48ea-ab61-04cc2b3edf74 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:27.803128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:27.843026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576103-82d4-40da-89f8-053289901448 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:27.910002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b2882-799a-44f4-8d69-9a639cb60736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:27.910979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2882-799a-44f4-8d69-9a639cb60736 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:27.911474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2882-799a-44f4-8d69-9a639cb60736 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:27.911940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2882-799a-44f4-8d69-9a639cb60736 None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:27.914064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b2882-799a-44f4-8d69-9a639cb60736 None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:27.916235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b2882-799a-44f4-8d69-9a639cb60736 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:27.920192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 197/388] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:27 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:27.926117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b2882-799a-44f4-8d69-9a639cb60736 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:27.959629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fc360-16f6-48ea-ab61-04cc2b3edf74 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:28.032071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402fd58-50d2-4b9a-aea5-aa455c8dd556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:28.033051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402fd58-50d2-4b9a-aea5-aa455c8dd556 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:28.033529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402fd58-50d2-4b9a-aea5-aa455c8dd556 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:28.034191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402fd58-50d2-4b9a-aea5-aa455c8dd556 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:28.036389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402fd58-50d2-4b9a-aea5-aa455c8dd556 None admin] RBAC: Adding query filter params (name=member) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:28.036900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402fd58-50d2-4b9a-aea5-aa455c8dd556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:28.039937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402fd58-50d2-4b9a-aea5-aa455c8dd556 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:28.054701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 192/389] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:28.064963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402fd58-50d2-4b9a-aea5-aa455c8dd556 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:28.114397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b2882-799a-44f4-8d69-9a639cb60736 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:28.120524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:28.162235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d871f-e444-4fab-a4ea-ee5c661c0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:28.163235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d871f-e444-4fab-a4ea-ee5c661c0f7e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:28.163798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d871f-e444-4fab-a4ea-ee5c661c0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:28.164849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d871f-e444-4fab-a4ea-ee5c661c0f7e None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:28.166274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d871f-e444-4fab-a4ea-ee5c661c0f7e None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:28.168803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d871f-e444-4fab-a4ea-ee5c661c0f7e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:28.171223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 198/390] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:27 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:28.172636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3221f2-ecfd-4236-b49c-76e39794c8b9 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:28.173165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3221f2-ecfd-4236-b49c-76e39794c8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:28.173627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3221f2-ecfd-4236-b49c-76e39794c8b9 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:28.175768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 199/391] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:28.186886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3221f2-ecfd-4236-b49c-76e39794c8b9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:28.200432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:28.204295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402fd58-50d2-4b9a-aea5-aa455c8dd556 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:28.245212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664296de-e7dd-4c5f-a926-9bfe83aae1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:28.245843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664296de-e7dd-4c5f-a926-9bfe83aae1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:28.246118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664296de-e7dd-4c5f-a926-9bfe83aae1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:28.246391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664296de-e7dd-4c5f-a926-9bfe83aae1a7 None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:28.247592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664296de-e7dd-4c5f-a926-9bfe83aae1a7 None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:28.249163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664296de-e7dd-4c5f-a926-9bfe83aae1a7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:28.251073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 193/392] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:28 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:28.252377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92d54-6c6a-43a8-908b-4cf27f769ddf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:28.252653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92d54-6c6a-43a8-908b-4cf27f769ddf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:28.252941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92d54-6c6a-43a8-908b-4cf27f769ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:28.273594 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-42c92d54-6c6a-43a8-908b-4cf27f769ddf None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:28.276097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-42c92d54-6c6a-43a8-908b-4cf27f769ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:28.324764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3221f2-ecfd-4236-b49c-76e39794c8b9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:28.366683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 194/393] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:28.366683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92d54-6c6a-43a8-908b-4cf27f769ddf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:28.375276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fab40-285f-4fdc-8a0e-bb5cb62e3bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:28.375955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fab40-285f-4fdc-8a0e-bb5cb62e3bcd None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:28.376222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fab40-285f-4fdc-8a0e-bb5cb62e3bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:28.376561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fab40-285f-4fdc-8a0e-bb5cb62e3bcd None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681/groups/44784d10306643b88431c1d682f45398/roles/d742575a6b40459fbb329defa3b642c5` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:28.380179 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fab40-285f-4fdc-8a0e-bb5cb62e3bcd None admin] RBAC: Authorizing `identity:create_grant(project_id=353afc27991d4d4bbe4860b6b70da681, group_id=44784d10306643b88431c1d682f45398, role_id=d742575a6b40459fbb329defa3b642c5)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:28.381696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fab40-285f-4fdc-8a0e-bb5cb62e3bcd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:28.411258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 200/394] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Sep 26 10:19:28 2022] PUT /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681/groups/44784d10306643b88431c1d682f45398/roles/d742575a6b40459fbb329defa3b642c5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:28.448915 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:28.542822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92d54-6c6a-43a8-908b-4cf27f769ddf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:28.580044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f4fb8-7956-4c0d-abf4-833d92aa2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:28.580688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f4fb8-7956-4c0d-abf4-833d92aa2aff None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:28.580987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f4fb8-7956-4c0d-abf4-833d92aa2aff None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:28.581269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f4fb8-7956-4c0d-abf4-833d92aa2aff None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:28.582501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f4fb8-7956-4c0d-abf4-833d92aa2aff None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:28.583978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f4fb8-7956-4c0d-abf4-833d92aa2aff None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:28.585757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 195/395] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:28 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:28.598445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fab40-285f-4fdc-8a0e-bb5cb62e3bcd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:28.659749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e77c7-1876-410c-a499-167be1ac56f5 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:28.660085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e77c7-1876-410c-a499-167be1ac56f5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:28.660293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e77c7-1876-410c-a499-167be1ac56f5 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:28.661910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 196/396] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:28.668572 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4ac9-3b43-4438-ad37-74e5aa6181c9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:28.669193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4ac9-3b43-4438-ad37-74e5aa6181c9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:28.669658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4ac9-3b43-4438-ad37-74e5aa6181c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:28.687864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:28.691090 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f55a4ac9-3b43-4438-ad37-74e5aa6181c9 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:28.692533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f55a4ac9-3b43-4438-ad37-74e5aa6181c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:28.725346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fab40-285f-4fdc-8a0e-bb5cb62e3bcd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:28.760437 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae52d7c-34aa-4848-b70b-8b76dbe20614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:28.761126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52d7c-34aa-4848-b70b-8b76dbe20614 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:28.761408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52d7c-34aa-4848-b70b-8b76dbe20614 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:28.761681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52d7c-34aa-4848-b70b-8b76dbe20614 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681/groups/44784d10306643b88431c1d682f45398/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:28.763704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae52d7c-34aa-4848-b70b-8b76dbe20614 None admin] RBAC: Authorizing `identity:create_grant(project_id=353afc27991d4d4bbe4860b6b70da681, group_id=44784d10306643b88431c1d682f45398, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:28.765166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae52d7c-34aa-4848-b70b-8b76dbe20614 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:28.778703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 197/397] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:28.779688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4ac9-3b43-4438-ad37-74e5aa6181c9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:28.786765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 201/398] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Sep 26 10:19:28 2022] PUT /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681/groups/44784d10306643b88431c1d682f45398/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:28.850345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:28.952553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4ac9-3b43-4438-ad37-74e5aa6181c9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:28.999720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea53cc-3576-4612-9d12-ca273c7d3a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:29.000276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea53cc-3576-4612-9d12-ca273c7d3a40 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:29.000549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea53cc-3576-4612-9d12-ca273c7d3a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:29.000820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea53cc-3576-4612-9d12-ca273c7d3a40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:29.014674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea53cc-3576-4612-9d12-ca273c7d3a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9aea53cc-3576-4612-9d12-ca273c7d3a40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:29.019871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:29.020860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:29.022130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 198/399] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:29.031372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae52d7c-34aa-4848-b70b-8b76dbe20614 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:29.101903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea53cc-3576-4612-9d12-ca273c7d3a40 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:29.172264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae52d7c-34aa-4848-b70b-8b76dbe20614 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:29.205677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:29.213798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab8e59-e4d0-41b8-b8fd-56b29cb8aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:29.214972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab8e59-e4d0-41b8-b8fd-56b29cb8aab5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:29.215883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab8e59-e4d0-41b8-b8fd-56b29cb8aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:29.216382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab8e59-e4d0-41b8-b8fd-56b29cb8aab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:29.217603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab8e59-e4d0-41b8-b8fd-56b29cb8aab5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:29.218102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab8e59-e4d0-41b8-b8fd-56b29cb8aab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:29.219770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab8e59-e4d0-41b8-b8fd-56b29cb8aab5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:29.232569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 202/400] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:29.234655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89719a86-0991-4911-9397-0d9a0c61d51e None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:29.235154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89719a86-0991-4911-9397-0d9a0c61d51e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:29.235628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89719a86-0991-4911-9397-0d9a0c61d51e None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:29.237622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 203/401] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:29.238620 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89719a86-0991-4911-9397-0d9a0c61d51e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:29.260525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:29.266510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea53cc-3576-4612-9d12-ca273c7d3a40 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:29.302585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42d701-17a4-4b07-a560-572af9d1c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:29.303261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42d701-17a4-4b07-a560-572af9d1c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:29.303537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42d701-17a4-4b07-a560-572af9d1c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:29.303855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42d701-17a4-4b07-a560-572af9d1c1c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:29.314988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42d701-17a4-4b07-a560-572af9d1c1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-db42d701-17a4-4b07-a560-572af9d1c1c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:29.320455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:29.322112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 199/402] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:19:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:29.327683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8b793-4966-4c57-829a-77350208cf8e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:29.328401 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8b793-4966-4c57-829a-77350208cf8e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:29.328401 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8b793-4966-4c57-829a-77350208cf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:29.343124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e3b8b793-4966-4c57-829a-77350208cf8e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:29.344353 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e3b8b793-4966-4c57-829a-77350208cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:29.381252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89719a86-0991-4911-9397-0d9a0c61d51e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:29.421509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba587eff-ef3c-4bdc-985a-0ae45c159f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:29.422490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba587eff-ef3c-4bdc-985a-0ae45c159f65 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:29.422964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba587eff-ef3c-4bdc-985a-0ae45c159f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:29.423430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba587eff-ef3c-4bdc-985a-0ae45c159f65 None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:29.425024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 200/403] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:29.426067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8b793-4966-4c57-829a-77350208cf8e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:29.430154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba587eff-ef3c-4bdc-985a-0ae45c159f65 None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:29.431806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba587eff-ef3c-4bdc-985a-0ae45c159f65 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:29.436292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 204/404] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:29 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:29.441209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba587eff-ef3c-4bdc-985a-0ae45c159f65 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:29.543333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:29.585951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba587eff-ef3c-4bdc-985a-0ae45c159f65 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:29.598163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:29.624089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af8b8d-8850-49be-82cf-73a909d6655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:29.625277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af8b8d-8850-49be-82cf-73a909d6655d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:29.627339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8b793-4966-4c57-829a-77350208cf8e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:29.629310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af8b8d-8850-49be-82cf-73a909d6655d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:29.630520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af8b8d-8850-49be-82cf-73a909d6655d None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:29.636409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af8b8d-8850-49be-82cf-73a909d6655d None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:29.638138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af8b8d-8850-49be-82cf-73a909d6655d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:29.640070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 205/405] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:29 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:29.647722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af8b8d-8850-49be-82cf-73a909d6655d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:29.735003 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48f537-1d2a-47c9-b6f8-fe59ae5bc761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:29.736396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48f537-1d2a-47c9-b6f8-fe59ae5bc761 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:29.736677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48f537-1d2a-47c9-b6f8-fe59ae5bc761 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:29.736959 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48f537-1d2a-47c9-b6f8-fe59ae5bc761 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:29.738400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48f537-1d2a-47c9-b6f8-fe59ae5bc761 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:29.738714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48f537-1d2a-47c9-b6f8-fe59ae5bc761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:29.740092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48f537-1d2a-47c9-b6f8-fe59ae5bc761 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:29.755331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af8b8d-8850-49be-82cf-73a909d6655d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:29.767385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 201/406] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:29.769957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48f537-1d2a-47c9-b6f8-fe59ae5bc761 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:29.800850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:29.811774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3114574-0896-49fc-bca4-c1f4f5fdbbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:29.812560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114574-0896-49fc-bca4-c1f4f5fdbbbd None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:29.812897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114574-0896-49fc-bca4-c1f4f5fdbbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:29.813319 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114574-0896-49fc-bca4-c1f4f5fdbbbd None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9/groups/44784d10306643b88431c1d682f45398/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:29.815448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3114574-0896-49fc-bca4-c1f4f5fdbbbd None admin] RBAC: Authorizing `identity:create_grant(project_id=a101cbee2fb049a984083ce237c81fe9, group_id=44784d10306643b88431c1d682f45398, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:29.817051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3114574-0896-49fc-bca4-c1f4f5fdbbbd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:29.837088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 206/407] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Sep 26 10:19:29 2022] PUT /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9/groups/44784d10306643b88431c1d682f45398/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:29.838010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3114574-0896-49fc-bca4-c1f4f5fdbbbd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:29.923287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48f537-1d2a-47c9-b6f8-fe59ae5bc761 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:29.989415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b12b-548d-4889-95c6-eb350af4e51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:29.990070 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b12b-548d-4889-95c6-eb350af4e51a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:29.990351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b12b-548d-4889-95c6-eb350af4e51a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:29.990628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b12b-548d-4889-95c6-eb350af4e51a None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:29.995698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b12b-548d-4889-95c6-eb350af4e51a None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:29.997317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b12b-548d-4889-95c6-eb350af4e51a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:29.999271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 202/408] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:29 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:30.005765 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b12b-548d-4889-95c6-eb350af4e51a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:30.041303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:30.055375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3114574-0896-49fc-bca4-c1f4f5fdbbbd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:30.107011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131534d8-5cac-4088-8d03-f88fa189904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:30.107647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131534d8-5cac-4088-8d03-f88fa189904c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:30.107928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131534d8-5cac-4088-8d03-f88fa189904c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:30.108199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131534d8-5cac-4088-8d03-f88fa189904c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:30.127873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131534d8-5cac-4088-8d03-f88fa189904c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-131534d8-5cac-4088-8d03-f88fa189904c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:30.134191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:30.135075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:30.135839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 207/409] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:19:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:30.148229 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131534d8-5cac-4088-8d03-f88fa189904c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:30.171042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b12b-548d-4889-95c6-eb350af4e51a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:30.235653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c967-2fa6-47fe-a264-c9f9300be341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:30.236529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c967-2fa6-47fe-a264-c9f9300be341 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:30.237194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c967-2fa6-47fe-a264-c9f9300be341 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:30.238372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0c967-2fa6-47fe-a264-c9f9300be341 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:30.240795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0c967-2fa6-47fe-a264-c9f9300be341 None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:30.243213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:30.245825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0c967-2fa6-47fe-a264-c9f9300be341 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:30.250267 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 203/410] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:30 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:30.255724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c967-2fa6-47fe-a264-c9f9300be341 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:30.343195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131534d8-5cac-4088-8d03-f88fa189904c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:30.415736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704eaba-921a-402e-aa66-05461fbb9e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:30.417191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704eaba-921a-402e-aa66-05461fbb9e22 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:30.417472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704eaba-921a-402e-aa66-05461fbb9e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:30.417741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704eaba-921a-402e-aa66-05461fbb9e22 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:30.418407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704eaba-921a-402e-aa66-05461fbb9e22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:30.418709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704eaba-921a-402e-aa66-05461fbb9e22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:30.420287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704eaba-921a-402e-aa66-05461fbb9e22 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:30.421721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:30.442112 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 208/411] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:30.449190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704eaba-921a-402e-aa66-05461fbb9e22 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:30.454971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0c967-2fa6-47fe-a264-c9f9300be341 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:30.520261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcb225-2f5c-4ba0-9b08-56d8dee7b397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:30.520930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcb225-2f5c-4ba0-9b08-56d8dee7b397 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:30.521261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcb225-2f5c-4ba0-9b08-56d8dee7b397 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:30.521534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcb225-2f5c-4ba0-9b08-56d8dee7b397 None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9/groups/44784d10306643b88431c1d682f45398/roles/d742575a6b40459fbb329defa3b642c5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:30.526207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcb225-2f5c-4ba0-9b08-56d8dee7b397 None admin] RBAC: Authorizing `identity:create_grant(project_id=a101cbee2fb049a984083ce237c81fe9, group_id=44784d10306643b88431c1d682f45398, role_id=d742575a6b40459fbb329defa3b642c5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:30.527650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcb225-2f5c-4ba0-9b08-56d8dee7b397 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:30.550259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 204/412] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Sep 26 10:19:30 2022] PUT /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9/groups/44784d10306643b88431c1d682f45398/roles/d742575a6b40459fbb329defa3b642c5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:30.600726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704eaba-921a-402e-aa66-05461fbb9e22 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:30.613375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:30.648419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba7320-7f20-47ba-b825-52209aa62cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:30.649175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7320-7f20-47ba-b825-52209aa62cfe None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:30.649460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7320-7f20-47ba-b825-52209aa62cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:30.649786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7320-7f20-47ba-b825-52209aa62cfe None admin] PATH_INFO: `/v3/groups/13758925a2204b2984a708aa65d16b93` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:30.653205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba7320-7f20-47ba-b825-52209aa62cfe None admin] RBAC: Authorizing `identity:get_group(group_id=13758925a2204b2984a708aa65d16b93)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:30.654681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba7320-7f20-47ba-b825-52209aa62cfe None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:30.656709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 209/413] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:30 2022] GET /identity/v3/groups/13758925a2204b2984a708aa65d16b93 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:30.662064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcb225-2f5c-4ba0-9b08-56d8dee7b397 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:30.780586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcb225-2f5c-4ba0-9b08-56d8dee7b397 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:30.823624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b49e3f-9a9d-41af-a902-b952bfb5b60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:30.824349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b49e3f-9a9d-41af-a902-b952bfb5b60a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:30.824632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b49e3f-9a9d-41af-a902-b952bfb5b60a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:30.824900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b49e3f-9a9d-41af-a902-b952bfb5b60a None admin] PATH_INFO: `/v3/projects/5634981824594276a0bd3022cd78b5df` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:30.826088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b49e3f-9a9d-41af-a902-b952bfb5b60a None admin] RBAC: Authorizing `identity:get_project(project_id=5634981824594276a0bd3022cd78b5df)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:30.827508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b49e3f-9a9d-41af-a902-b952bfb5b60a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:30.829502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 205/414] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:30 2022] GET /identity/v3/projects/5634981824594276a0bd3022cd78b5df => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:30.835202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba7320-7f20-47ba-b825-52209aa62cfe None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:30.902563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8217ae-81f2-482c-91f6-9b0a5cab31b9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:30.902746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8217ae-81f2-482c-91f6-9b0a5cab31b9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:30.903011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8217ae-81f2-482c-91f6-9b0a5cab31b9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:30.904405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 206/415] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:30.922575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76d24-b035-411d-ba53-1000fc495ea9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:30.922865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76d24-b035-411d-ba53-1000fc495ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:30.923122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76d24-b035-411d-ba53-1000fc495ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:30.949661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba7320-7f20-47ba-b825-52209aa62cfe None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:30.956048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d1b76d24-b035-411d-ba53-1000fc495ea9 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:30.957266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d1b76d24-b035-411d-ba53-1000fc495ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:30.969435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:30.984593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ff895-c410-462f-945b-8f380a2dc2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:30.985292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ff895-c410-462f-945b-8f380a2dc2e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:30.985569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ff895-c410-462f-945b-8f380a2dc2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:30.985849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ff895-c410-462f-945b-8f380a2dc2e5 None admin] PATH_INFO: `/v3/projects/5634981824594276a0bd3022cd78b5df/groups/13758925a2204b2984a708aa65d16b93/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:30.987891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ff895-c410-462f-945b-8f380a2dc2e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5634981824594276a0bd3022cd78b5df, group_id=13758925a2204b2984a708aa65d16b93, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:30.989326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ff895-c410-462f-945b-8f380a2dc2e5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:31.004583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 210/416] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Sep 26 10:19:30 2022] PUT /identity/v3/projects/5634981824594276a0bd3022cd78b5df/groups/13758925a2204b2984a708aa65d16b93/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:19:31.110349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 207/417] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:31.305053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca88d8-1e81-4ab3-9c42-7d9c163ed227 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:31.305388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca88d8-1e81-4ab3-9c42-7d9c163ed227 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:31.305587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca88d8-1e81-4ab3-9c42-7d9c163ed227 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:31.307676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 211/418] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:31.313049 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7d33b-0a69-48a9-927f-42bf56721496 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:31.313336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7d33b-0a69-48a9-927f-42bf56721496 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:31.313614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7d33b-0a69-48a9-927f-42bf56721496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:31.331902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c3c7d33b-0a69-48a9-927f-42bf56721496 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:31.333117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c3c7d33b-0a69-48a9-927f-42bf56721496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:31.441184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 208/419] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:31.491526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca88d8-1e81-4ab3-9c42-7d9c163ed227 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:31.534524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:31.622524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca88d8-1e81-4ab3-9c42-7d9c163ed227 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:31.673668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8367d-d7ba-415a-a11f-beb1558d3bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:31.674296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8367d-d7ba-415a-a11f-beb1558d3bcd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:31.674571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8367d-d7ba-415a-a11f-beb1558d3bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:31.674838 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8367d-d7ba-415a-a11f-beb1558d3bcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:31.693768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8367d-d7ba-415a-a11f-beb1558d3bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d3b8367d-d7ba-415a-a11f-beb1558d3bcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:31.699093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:31.699955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:31.700742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 212/420] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:19:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:31.706000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7d33b-0a69-48a9-927f-42bf56721496 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:31.788255 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:31.843611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7d33b-0a69-48a9-927f-42bf56721496 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:31.847240 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8367d-d7ba-415a-a11f-beb1558d3bcd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:31.905466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633bf63-41d9-4397-bdc6-e4561ca35f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:31.905990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633bf63-41d9-4397-bdc6-e4561ca35f74 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:31.906265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633bf63-41d9-4397-bdc6-e4561ca35f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:31.906535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633bf63-41d9-4397-bdc6-e4561ca35f74 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:31.907197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633bf63-41d9-4397-bdc6-e4561ca35f74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:31.907497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633bf63-41d9-4397-bdc6-e4561ca35f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:31.908863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633bf63-41d9-4397-bdc6-e4561ca35f74 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:31.923300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 209/421] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:31.926706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633bf63-41d9-4397-bdc6-e4561ca35f74 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:32.018504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:32.026676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8367d-d7ba-415a-a11f-beb1558d3bcd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:32.063377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633bf63-41d9-4397-bdc6-e4561ca35f74 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:32.099534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addca8cf-5fae-42b2-a00d-06b3b5f4a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:32.100144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addca8cf-5fae-42b2-a00d-06b3b5f4a7fc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:32.100423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addca8cf-5fae-42b2-a00d-06b3b5f4a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:32.100692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addca8cf-5fae-42b2-a00d-06b3b5f4a7fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:32.105248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:32.133114 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4c1ed-4f19-4ebe-8401-4c2c4b498ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:32.134204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4c1ed-4f19-4ebe-8401-4c2c4b498ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:32.134737 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4c1ed-4f19-4ebe-8401-4c2c4b498ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:32.135418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4c1ed-4f19-4ebe-8401-4c2c4b498ef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:32.161077 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4c1ed-4f19-4ebe-8401-4c2c4b498ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-03d4c1ed-4f19-4ebe-8401-4c2c4b498ef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:32.164729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:32.165722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:32.166513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 213/422] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:19:32.175858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4c1ed-4f19-4ebe-8401-4c2c4b498ef1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:32.227288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addca8cf-5fae-42b2-a00d-06b3b5f4a7fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:32.229326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addca8cf-5fae-42b2-a00d-06b3b5f4a7fc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:32.320661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4c1ed-4f19-4ebe-8401-4c2c4b498ef1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:32.358018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebb50a-44f2-4e3a-b0b9-63278064a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:32.358629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebb50a-44f2-4e3a-b0b9-63278064a85d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:32.358911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebb50a-44f2-4e3a-b0b9-63278064a85d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:32.359291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebb50a-44f2-4e3a-b0b9-63278064a85d None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:32.359975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebb50a-44f2-4e3a-b0b9-63278064a85d None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:32.360280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebb50a-44f2-4e3a-b0b9-63278064a85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:32.361735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebb50a-44f2-4e3a-b0b9-63278064a85d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:32.371685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 214/423] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:32.377411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebb50a-44f2-4e3a-b0b9-63278064a85d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:32.404095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:32.443739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 210/424] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 10:19:32.449760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addca8cf-5fae-42b2-a00d-06b3b5f4a7fc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:32.489393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebb50a-44f2-4e3a-b0b9-63278064a85d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:32.502906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:32.527944 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467537b-daf2-4d6d-a95b-8473c528838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:32.528795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467537b-daf2-4d6d-a95b-8473c528838a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:32.529259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467537b-daf2-4d6d-a95b-8473c528838a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:32.529804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467537b-daf2-4d6d-a95b-8473c528838a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:32.576784 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addca8cf-5fae-42b2-a00d-06b3b5f4a7fc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:32.607906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467537b-daf2-4d6d-a95b-8473c528838a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:32.609579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467537b-daf2-4d6d-a95b-8473c528838a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:32.611999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe229f-d6f5-448e-9754-53eeab7f9da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:32.613046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe229f-d6f5-448e-9754-53eeab7f9da5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:32.613315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe229f-d6f5-448e-9754-53eeab7f9da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:32.613682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe229f-d6f5-448e-9754-53eeab7f9da5 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:32.614904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe229f-d6f5-448e-9754-53eeab7f9da5 None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:32.616542 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe229f-d6f5-448e-9754-53eeab7f9da5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:32.623693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 211/425] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:32 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:32.625158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321be88-2e2c-4f1b-98cb-36c7fe98923f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:32.625541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321be88-2e2c-4f1b-98cb-36c7fe98923f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:32.625915 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321be88-2e2c-4f1b-98cb-36c7fe98923f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:32.627867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 212/426] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:32.628672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321be88-2e2c-4f1b-98cb-36c7fe98923f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:32.635526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:32.733781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 215/427] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:32.735512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875de9-cc46-4a6a-b597-36b0e09dc6d4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:32.735998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875de9-cc46-4a6a-b597-36b0e09dc6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:32.736484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875de9-cc46-4a6a-b597-36b0e09dc6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:32.753671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321be88-2e2c-4f1b-98cb-36c7fe98923f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:32.755227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:32.759377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-66875de9-cc46-4a6a-b597-36b0e09dc6d4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:32.760809 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-66875de9-cc46-4a6a-b597-36b0e09dc6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:32.792742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1204a-f801-4f2f-9eb4-429bbea09a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:32.793411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1204a-f801-4f2f-9eb4-429bbea09a50 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:32.793690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1204a-f801-4f2f-9eb4-429bbea09a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:32.793964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1204a-f801-4f2f-9eb4-429bbea09a50 None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:32.795303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1204a-f801-4f2f-9eb4-429bbea09a50 None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:32.796806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1204a-f801-4f2f-9eb4-429bbea09a50 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:32.801020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 213/428] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:32 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:32.802059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1204a-f801-4f2f-9eb4-429bbea09a50 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:32.844095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 216/429] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:32.845395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66875de9-cc46-4a6a-b597-36b0e09dc6d4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:32.901855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:32.946182 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1204a-f801-4f2f-9eb4-429bbea09a50 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:32.978668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66875de9-cc46-4a6a-b597-36b0e09dc6d4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:33.012396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f751-de40-43f2-904c-8e74e099f6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:33.013598 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f751-de40-43f2-904c-8e74e099f6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.014078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f751-de40-43f2-904c-8e74e099f6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.014573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f751-de40-43f2-904c-8e74e099f6b2 None admin] PATH_INFO: `/v3/projects/353afc27991d4d4bbe4860b6b70da681` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.015896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f751-de40-43f2-904c-8e74e099f6b2 None admin] RBAC: Authorizing `identity:get_project(project_id=353afc27991d4d4bbe4860b6b70da681)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:33.017541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3f751-de40-43f2-904c-8e74e099f6b2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:33.019823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 214/430] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:32 2022] GET /identity/v3/projects/353afc27991d4d4bbe4860b6b70da681 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:33.025663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f751-de40-43f2-904c-8e74e099f6b2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:33.052490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ccfe2-50a1-4ddd-8b1a-9e6a2ce482ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:33.053134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ccfe2-50a1-4ddd-8b1a-9e6a2ce482ae None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.053473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ccfe2-50a1-4ddd-8b1a-9e6a2ce482ae None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.053744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ccfe2-50a1-4ddd-8b1a-9e6a2ce482ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.054542 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ccfe2-50a1-4ddd-8b1a-9e6a2ce482ae None admin] RBAC: Adding query filter params (group.id=44784d10306643b88431c1d682f45398, role.id=d742575a6b40459fbb329defa3b642c5, scope.project.id=353afc27991d4d4bbe4860b6b70da681) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:33.054847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ccfe2-50a1-4ddd-8b1a-9e6a2ce482ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:33.056442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ccfe2-50a1-4ddd-8b1a-9e6a2ce482ae None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:33.069298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 217/431] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 10:19:32 2022] GET /identity/v3/role_assignments?group.id=44784d10306643b88431c1d682f45398&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=d742575a6b40459fbb329defa3b642c5 => generated 611 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:33.106811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:33.164818 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ccfe2-50a1-4ddd-8b1a-9e6a2ce482ae None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:33.217600 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f751-de40-43f2-904c-8e74e099f6b2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:33.272122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acc5e5-e3a8-4410-979e-8fb40203a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:33.272742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acc5e5-e3a8-4410-979e-8fb40203a086 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.273080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acc5e5-e3a8-4410-979e-8fb40203a086 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.273358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acc5e5-e3a8-4410-979e-8fb40203a086 None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.275776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acc5e5-e3a8-4410-979e-8fb40203a086 None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:33.277298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acc5e5-e3a8-4410-979e-8fb40203a086 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:33.279172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 215/432] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:33 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:33.281043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11092d-4730-4866-ab50-b96848239506 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.281155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11092d-4730-4866-ab50-b96848239506 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.281338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11092d-4730-4866-ab50-b96848239506 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.283853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 216/433] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:33.289547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11092d-4730-4866-ab50-b96848239506 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:33.293571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ccfe2-50a1-4ddd-8b1a-9e6a2ce482ae None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:33.311476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:33.338153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3378b-7648-48e0-9859-47e44118cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:33.338784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3378b-7648-48e0-9859-47e44118cb08 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.339062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3378b-7648-48e0-9859-47e44118cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.339332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3378b-7648-48e0-9859-47e44118cb08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.353313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3378b-7648-48e0-9859-47e44118cb08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-97c3378b-7648-48e0-9859-47e44118cb08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:33.358946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:33.359802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 10:19:33.360576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:33.362742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 218/434] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:33.364048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304f32e-e4c2-4c33-903d-627162a05ac0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.364460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304f32e-e4c2-4c33-903d-627162a05ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.364872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304f32e-e4c2-4c33-903d-627162a05ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.383568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d304f32e-e4c2-4c33-903d-627162a05ac0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:33.385417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d304f32e-e4c2-4c33-903d-627162a05ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:33.411802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11092d-4730-4866-ab50-b96848239506 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:33.421788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:33.451761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e965a-9e4d-468e-bb14-fced7dbfbca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:33.452397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e965a-9e4d-468e-bb14-fced7dbfbca0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.452643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e965a-9e4d-468e-bb14-fced7dbfbca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.452913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e965a-9e4d-468e-bb14-fced7dbfbca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.453661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e965a-9e4d-468e-bb14-fced7dbfbca0 None admin] RBAC: Adding query filter params (group.id=44784d10306643b88431c1d682f45398, role.id=d598e7097e2d496f971598b09965388a, scope.project.id=353afc27991d4d4bbe4860b6b70da681) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:33.453970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e965a-9e4d-468e-bb14-fced7dbfbca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:33.455390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e965a-9e4d-468e-bb14-fced7dbfbca0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:33.461294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 219/435] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:33.461294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304f32e-e4c2-4c33-903d-627162a05ac0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:33.475721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 217/436] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 10:19:33 2022] GET /identity/v3/role_assignments?group.id=44784d10306643b88431c1d682f45398&scope.project.id=353afc27991d4d4bbe4860b6b70da681&role.id=d598e7097e2d496f971598b09965388a => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:33.570189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304f32e-e4c2-4c33-903d-627162a05ac0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:33.573715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:33.607937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeac51f-f71b-4167-a6a1-02ea482dac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:33.608800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeac51f-f71b-4167-a6a1-02ea482dac6d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.609251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeac51f-f71b-4167-a6a1-02ea482dac6d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.609691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeac51f-f71b-4167-a6a1-02ea482dac6d None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.610515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeac51f-f71b-4167-a6a1-02ea482dac6d None admin] RBAC: Adding query filter params (name=member) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:33.610978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeac51f-f71b-4167-a6a1-02ea482dac6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:33.612525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeac51f-f71b-4167-a6a1-02ea482dac6d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:33.623060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 220/437] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:19:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:33.631414 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e965a-9e4d-468e-bb14-fced7dbfbca0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:33.735797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeac51f-f71b-4167-a6a1-02ea482dac6d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:33.762106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e965a-9e4d-468e-bb14-fced7dbfbca0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:33.799623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e8816-7510-4f27-b5d3-f75fde7d32aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:33.800352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e8816-7510-4f27-b5d3-f75fde7d32aa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.800643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e8816-7510-4f27-b5d3-f75fde7d32aa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.800919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e8816-7510-4f27-b5d3-f75fde7d32aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.850377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:33.858487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeac51f-f71b-4167-a6a1-02ea482dac6d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:33.886034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e8816-7510-4f27-b5d3-f75fde7d32aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:33.887488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e8816-7510-4f27-b5d3-f75fde7d32aa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:33.899461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93a699-6e75-4719-988e-f4c4829a2206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:33.900706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a699-6e75-4719-988e-f4c4829a2206 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.901289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a699-6e75-4719-988e-f4c4829a2206 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.901572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a699-6e75-4719-988e-f4c4829a2206 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.913767 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93a699-6e75-4719-988e-f4c4829a2206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-db93a699-6e75-4719-988e-f4c4829a2206 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:33.919666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:33.920520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 221/438] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:19:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:19:33.922334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ec44a-50bf-4a51-9699-9a569fae96a4 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:33.923037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ec44a-50bf-4a51-9699-9a569fae96a4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:33.923037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ec44a-50bf-4a51-9699-9a569fae96a4 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:33.923931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 222/439] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:33.928757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ec44a-50bf-4a51-9699-9a569fae96a4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:33.961070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:34.007756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 218/440] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:34.007756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9a70c-7edd-4ecb-9a9a-7041882cc3c5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.007756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9a70c-7edd-4ecb-9a9a-7041882cc3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.007756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9a70c-7edd-4ecb-9a9a-7041882cc3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.026692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-80f9a70c-7edd-4ecb-9a9a-7041882cc3c5 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:34.027885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-80f9a70c-7edd-4ecb-9a9a-7041882cc3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:34.054092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ec44a-50bf-4a51-9699-9a569fae96a4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:34.090576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec42e-f72a-4a5e-a5a7-aede8c354252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:34.091175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec42e-f72a-4a5e-a5a7-aede8c354252 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.091453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec42e-f72a-4a5e-a5a7-aede8c354252 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.091721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec42e-f72a-4a5e-a5a7-aede8c354252 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.092370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ec42e-f72a-4a5e-a5a7-aede8c354252 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:34.092670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ec42e-f72a-4a5e-a5a7-aede8c354252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:34.094060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ec42e-f72a-4a5e-a5a7-aede8c354252 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:34.098322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:34.102439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 223/441] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:34.102982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec42e-f72a-4a5e-a5a7-aede8c354252 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:34.103441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 219/442] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:34.120971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9a70c-7edd-4ecb-9a9a-7041882cc3c5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:34.193002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:34.207905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec42e-f72a-4a5e-a5a7-aede8c354252 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:34.217426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9a70c-7edd-4ecb-9a9a-7041882cc3c5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:34.248405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f83e-1744-4b62-a4e9-db251cab90ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:34.249057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f83e-1744-4b62-a4e9-db251cab90ed None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.249335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f83e-1744-4b62-a4e9-db251cab90ed None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.249604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409f83e-1744-4b62-a4e9-db251cab90ed None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.250691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409f83e-1744-4b62-a4e9-db251cab90ed None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:34.251234 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd62ec-29e9-4586-acc5-888d44963f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:34.251837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd62ec-29e9-4586-acc5-888d44963f8e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.252098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409f83e-1744-4b62-a4e9-db251cab90ed None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:34.252192 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd62ec-29e9-4586-acc5-888d44963f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.252372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd62ec-29e9-4586-acc5-888d44963f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.253888 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 224/443] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:34 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:34.259050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f83e-1744-4b62-a4e9-db251cab90ed None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:34.324691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:34.327715 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd62ec-29e9-4586-acc5-888d44963f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:34.330237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd62ec-29e9-4586-acc5-888d44963f8e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:34.361951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409f83e-1744-4b62-a4e9-db251cab90ed None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:34.397874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ec770-d0e1-4b81-b979-d56c124cec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:34.398493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ec770-d0e1-4b81-b979-d56c124cec00 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.398765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ec770-d0e1-4b81-b979-d56c124cec00 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.399034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ec770-d0e1-4b81-b979-d56c124cec00 None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.400140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ec770-d0e1-4b81-b979-d56c124cec00 None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:34.401857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ec770-d0e1-4b81-b979-d56c124cec00 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:34.403404 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 225/444] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:34 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:34.404133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ec770-d0e1-4b81-b979-d56c124cec00 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:34.432369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:34.437538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 220/445] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:34.438379 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd62ec-29e9-4586-acc5-888d44963f8e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:34.511200 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ec770-d0e1-4b81-b979-d56c124cec00 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:34.536864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:34.540371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd62ec-29e9-4586-acc5-888d44963f8e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:34.544454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0327-ec61-47be-b99e-f75443c904ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:34.545117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0327-ec61-47be-b99e-f75443c904ac None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.545398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0327-ec61-47be-b99e-f75443c904ac None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.545669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0327-ec61-47be-b99e-f75443c904ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.555850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e0327-ec61-47be-b99e-f75443c904ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-8e3e0327-ec61-47be-b99e-f75443c904ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:34.561141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:34.562005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:34.562797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 226/446] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:34.563445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0327-ec61-47be-b99e-f75443c904ac None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:34.576101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033d7a9-5c45-4772-b6ba-5d1d581772ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:34.576702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d7a9-5c45-4772-b6ba-5d1d581772ba None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.577007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d7a9-5c45-4772-b6ba-5d1d581772ba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.577288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d7a9-5c45-4772-b6ba-5d1d581772ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.578027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033d7a9-5c45-4772-b6ba-5d1d581772ba None admin] RBAC: Adding query filter params (group.id=44784d10306643b88431c1d682f45398, role.id=d598e7097e2d496f971598b09965388a, scope.project.id=a101cbee2fb049a984083ce237c81fe9) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:34.578337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033d7a9-5c45-4772-b6ba-5d1d581772ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:34.579764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033d7a9-5c45-4772-b6ba-5d1d581772ba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:34.585340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 221/447] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 10:19:34 2022] GET /identity/v3/role_assignments?group.id=44784d10306643b88431c1d682f45398&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=d598e7097e2d496f971598b09965388a => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:34.586094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033d7a9-5c45-4772-b6ba-5d1d581772ba None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:34.664045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:34.682691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0327-ec61-47be-b99e-f75443c904ac None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:34.699065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033d7a9-5c45-4772-b6ba-5d1d581772ba None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:34.717715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bd35a-6691-46ca-84e0-cb9cf3aba68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:34.718359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bd35a-6691-46ca-84e0-cb9cf3aba68c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.718637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bd35a-6691-46ca-84e0-cb9cf3aba68c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.718909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bd35a-6691-46ca-84e0-cb9cf3aba68c None admin] PATH_INFO: `/v3/projects/a101cbee2fb049a984083ce237c81fe9` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.720053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bd35a-6691-46ca-84e0-cb9cf3aba68c None admin] RBAC: Authorizing `identity:get_project(project_id=a101cbee2fb049a984083ce237c81fe9)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:34.721545 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bd35a-6691-46ca-84e0-cb9cf3aba68c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:34.723214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 227/448] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:34 2022] GET /identity/v3/projects/a101cbee2fb049a984083ce237c81fe9 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:34.729597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bd35a-6691-46ca-84e0-cb9cf3aba68c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:34.738709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777d32a-2989-49ea-8fa2-399aabc571f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:34.739328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777d32a-2989-49ea-8fa2-399aabc571f8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.739607 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777d32a-2989-49ea-8fa2-399aabc571f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.739877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777d32a-2989-49ea-8fa2-399aabc571f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.740541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777d32a-2989-49ea-8fa2-399aabc571f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:34.740841 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777d32a-2989-49ea-8fa2-399aabc571f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:34.742261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777d32a-2989-49ea-8fa2-399aabc571f8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:34.751661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 222/449] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:34.757764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777d32a-2989-49ea-8fa2-399aabc571f8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:34.788837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:34.862658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bd35a-6691-46ca-84e0-cb9cf3aba68c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:34.876582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777d32a-2989-49ea-8fa2-399aabc571f8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:34.904177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336faec-6b94-4113-9d03-41c49865ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:34.905185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336faec-6b94-4113-9d03-41c49865ad26 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.905654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336faec-6b94-4113-9d03-41c49865ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.905924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336faec-6b94-4113-9d03-41c49865ad26 None admin] PATH_INFO: `/v3/groups/44784d10306643b88431c1d682f45398` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.907101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336faec-6b94-4113-9d03-41c49865ad26 None admin] RBAC: Authorizing `identity:get_group(group_id=44784d10306643b88431c1d682f45398)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:34.908531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336faec-6b94-4113-9d03-41c49865ad26 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:34.914853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 228/450] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:34 2022] GET /identity/v3/groups/44784d10306643b88431c1d682f45398 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:34.916707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336faec-6b94-4113-9d03-41c49865ad26 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:34.919207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f75cf-b439-4a56-8715-327b1c6ceb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:34.920012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f75cf-b439-4a56-8715-327b1c6ceb2e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:34.920012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f75cf-b439-4a56-8715-327b1c6ceb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:34.920183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f75cf-b439-4a56-8715-327b1c6ceb2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:34.943159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:34.999128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f75cf-b439-4a56-8715-327b1c6ceb2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:35.000575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f75cf-b439-4a56-8715-327b1c6ceb2e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:35.024093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336faec-6b94-4113-9d03-41c49865ad26 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:35.026359 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:35.056735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e17a8-487c-4dec-ac91-5eff0445edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:35.057353 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e17a8-487c-4dec-ac91-5eff0445edea None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:35.057636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e17a8-487c-4dec-ac91-5eff0445edea None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:35.057909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e17a8-487c-4dec-ac91-5eff0445edea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:35.058622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e17a8-487c-4dec-ac91-5eff0445edea None admin] RBAC: Adding query filter params (group.id=44784d10306643b88431c1d682f45398, role.id=d742575a6b40459fbb329defa3b642c5, scope.project.id=a101cbee2fb049a984083ce237c81fe9) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:35.058931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e17a8-487c-4dec-ac91-5eff0445edea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:35.060336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e17a8-487c-4dec-ac91-5eff0445edea None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:35.065851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 229/451] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 10:19:34 2022] GET /identity/v3/role_assignments?group.id=44784d10306643b88431c1d682f45398&scope.project.id=a101cbee2fb049a984083ce237c81fe9&role.id=d742575a6b40459fbb329defa3b642c5 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:35.103790 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 223/452] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 10:19:35.110579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e17a8-487c-4dec-ac91-5eff0445edea None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:35.197868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:35.214356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e17a8-487c-4dec-ac91-5eff0445edea None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:35.248716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30c5b-e8c4-4b86-a5ff-bc337d47db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:35.249364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30c5b-e8c4-4b86-a5ff-bc337d47db61 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:35.249644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30c5b-e8c4-4b86-a5ff-bc337d47db61 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:35.249919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30c5b-e8c4-4b86-a5ff-bc337d47db61 None admin] PATH_INFO: `/v3/projects/5634981824594276a0bd3022cd78b5df` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:35.251034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e30c5b-e8c4-4b86-a5ff-bc337d47db61 None admin] RBAC: Authorizing `identity:get_project(project_id=5634981824594276a0bd3022cd78b5df)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:35.252461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e30c5b-e8c4-4b86-a5ff-bc337d47db61 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:35.254309 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 230/453] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:19:35 2022] GET /identity/v3/projects/5634981824594276a0bd3022cd78b5df => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:35.259698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f75cf-b439-4a56-8715-327b1c6ceb2e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:35.359820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f75cf-b439-4a56-8715-327b1c6ceb2e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:35.386285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:35.395741 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96e132-0392-4932-8223-2bcc5683842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:35.396378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e132-0392-4932-8223-2bcc5683842e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:35.396655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e132-0392-4932-8223-2bcc5683842e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:35.396927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e132-0392-4932-8223-2bcc5683842e None admin] PATH_INFO: `/v3/groups/13758925a2204b2984a708aa65d16b93` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:35.398056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96e132-0392-4932-8223-2bcc5683842e None admin] RBAC: Authorizing `identity:get_group(group_id=13758925a2204b2984a708aa65d16b93)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:35.399976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96e132-0392-4932-8223-2bcc5683842e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:35.401351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 224/454] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 10:19:35 2022] GET /identity/v3/groups/13758925a2204b2984a708aa65d16b93 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:35.407221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30c5b-e8c4-4b86-a5ff-bc337d47db61 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:35.505031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30c5b-e8c4-4b86-a5ff-bc337d47db61 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:35.536495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011ddb5-a7eb-40ba-8396-9d6e53fee245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:35.537108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ddb5-a7eb-40ba-8396-9d6e53fee245 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:35.537408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ddb5-a7eb-40ba-8396-9d6e53fee245 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:35.537664 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ddb5-a7eb-40ba-8396-9d6e53fee245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:35.538386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ddb5-a7eb-40ba-8396-9d6e53fee245 None admin] RBAC: Adding query filter params (group.id=13758925a2204b2984a708aa65d16b93, role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=5634981824594276a0bd3022cd78b5df) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:35.538693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ddb5-a7eb-40ba-8396-9d6e53fee245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:35.540598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ddb5-a7eb-40ba-8396-9d6e53fee245 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:35.546104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 231/455] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 10:19:35 2022] GET /identity/v3/role_assignments?group.id=13758925a2204b2984a708aa65d16b93&scope.project.id=5634981824594276a0bd3022cd78b5df&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:38.062978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da0d07-2ba3-4616-a5c0-1b85ecfe134f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:38.063491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da0d07-2ba3-4616-a5c0-1b85ecfe134f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:38.063491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da0d07-2ba3-4616-a5c0-1b85ecfe134f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:38.064814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 225/456] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:38.070170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64099b24-e0d1-4df2-8059-c23b8fb032cb None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:38.070960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64099b24-e0d1-4df2-8059-c23b8fb032cb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:38.071508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64099b24-e0d1-4df2-8059-c23b8fb032cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:38.101939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-64099b24-e0d1-4df2-8059-c23b8fb032cb None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:38.103533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-64099b24-e0d1-4df2-8059-c23b8fb032cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:38.115107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:38.188600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 232/457] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:38.392758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179532f-3c23-4b7b-b148-e31dfa3769a4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:38.393061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179532f-3c23-4b7b-b148-e31dfa3769a4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:38.393573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179532f-3c23-4b7b-b148-e31dfa3769a4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:38.395346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 226/458] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:38.400362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ac4c0-d6ae-4c51-8c58-a873526df044 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:38.401162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ac4c0-d6ae-4c51-8c58-a873526df044 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:38.401643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ac4c0-d6ae-4c51-8c58-a873526df044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:38.429031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-351ac4c0-d6ae-4c51-8c58-a873526df044 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:38.430536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-351ac4c0-d6ae-4c51-8c58-a873526df044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:38.527744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 233/459] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:38.559997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179532f-3c23-4b7b-b148-e31dfa3769a4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:38.688925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179532f-3c23-4b7b-b148-e31dfa3769a4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:38.729017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26033d-7ada-43cf-bd76-05d8124f427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:38.729995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26033d-7ada-43cf-bd76-05d8124f427d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:38.730474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26033d-7ada-43cf-bd76-05d8124f427d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:38.730942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26033d-7ada-43cf-bd76-05d8124f427d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:38.749102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26033d-7ada-43cf-bd76-05d8124f427d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:38.750837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26033d-7ada-43cf-bd76-05d8124f427d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7b26033d-7ada-43cf-bd76-05d8124f427d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:38.769265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:38.770207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:38.771062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:38.771062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:38.771062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:38.772848 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 227/460] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:38.779651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ac4c0-d6ae-4c51-8c58-a873526df044 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:38.837683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26033d-7ada-43cf-bd76-05d8124f427d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:38.902577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:38.914964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:38.935535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ac4c0-d6ae-4c51-8c58-a873526df044 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:38.979710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed4b3-cfa1-455c-886d-073e1f2df535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:38.980266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed4b3-cfa1-455c-886d-073e1f2df535 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:38.980542 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed4b3-cfa1-455c-886d-073e1f2df535 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:38.980809 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed4b3-cfa1-455c-886d-073e1f2df535 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:38.981597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed4b3-cfa1-455c-886d-073e1f2df535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:38.981894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed4b3-cfa1-455c-886d-073e1f2df535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:38.983350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed4b3-cfa1-455c-886d-073e1f2df535 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:38.984974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26033d-7ada-43cf-bd76-05d8124f427d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:38.997107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 234/461] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:38.997107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8a9d6-0902-493c-a2c6-d7048e2abd31 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:38.997355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8a9d6-0902-493c-a2c6-d7048e2abd31 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:38.997517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8a9d6-0902-493c-a2c6-d7048e2abd31 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:38.998682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 235/462] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:38.999948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af202d-2005-4cd2-8353-7a7bb736ef5e None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.000055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af202d-2005-4cd2-8353-7a7bb736ef5e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.000305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af202d-2005-4cd2-8353-7a7bb736ef5e None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.001728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 236/463] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:39.002269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af202d-2005-4cd2-8353-7a7bb736ef5e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:39.028208 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f39b-5476-407a-bcb3-b92716af4af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:39.029327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f39b-5476-407a-bcb3-b92716af4af6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.029843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f39b-5476-407a-bcb3-b92716af4af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.030319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f39b-5476-407a-bcb3-b92716af4af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.042143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f39b-5476-407a-bcb3-b92716af4af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:39.043819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f39b-5476-407a-bcb3-b92716af4af6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-63d8f39b-5476-407a-bcb3-b92716af4af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:39.059121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:39.060009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:39.061077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:39.061077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:39.061077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:39.062127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 228/464] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:39.063269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1235-83df-48c7-a911-7b48fd96bb7b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.063780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1235-83df-48c7-a911-7b48fd96bb7b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.063780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1235-83df-48c7-a911-7b48fd96bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.081610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cdfd1235-83df-48c7-a911-7b48fd96bb7b None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:39.082806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cdfd1235-83df-48c7-a911-7b48fd96bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:39.116547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af202d-2005-4cd2-8353-7a7bb736ef5e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:39.152275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 229/465] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:39.154976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c192c-30d8-4e3f-bd77-6163f01f4fad None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.155326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c192c-30d8-4e3f-bd77-6163f01f4fad None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.155612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c192c-30d8-4e3f-bd77-6163f01f4fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.164387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e74aea-d553-4cc2-b1a1-dd18ee8c79ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:39.165358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e74aea-d553-4cc2-b1a1-dd18ee8c79ed None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.165835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e74aea-d553-4cc2-b1a1-dd18ee8c79ed None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.166363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e74aea-d553-4cc2-b1a1-dd18ee8c79ed None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.167237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e74aea-d553-4cc2-b1a1-dd18ee8c79ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:39.168871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e74aea-d553-4cc2-b1a1-dd18ee8c79ed None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:39.176248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-807c192c-30d8-4e3f-bd77-6163f01f4fad None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:39.177459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-807c192c-30d8-4e3f-bd77-6163f01f4fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:39.179440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:39.196816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 237/466] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:19:39 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:19:39.198049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e74aea-d553-4cc2-b1a1-dd18ee8c79ed None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:39.207928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:39.260095 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 230/467] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:39.309710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e74aea-d553-4cc2-b1a1-dd18ee8c79ed None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:39.347634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba008be-c4f8-4e69-a41b-56b9a4bef5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:39.348530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba008be-c4f8-4e69-a41b-56b9a4bef5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.348988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba008be-c4f8-4e69-a41b-56b9a4bef5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.349400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba008be-c4f8-4e69-a41b-56b9a4bef5f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.350193 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba008be-c4f8-4e69-a41b-56b9a4bef5f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:39.350671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba008be-c4f8-4e69-a41b-56b9a4bef5f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:39.352524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba008be-c4f8-4e69-a41b-56b9a4bef5f1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:39.378458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 238/468] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:39.386080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c192c-30d8-4e3f-bd77-6163f01f4fad None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:39.515908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c192c-30d8-4e3f-bd77-6163f01f4fad None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:39.553685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba008be-c4f8-4e69-a41b-56b9a4bef5f1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:39.554267 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbb07d-b8bb-4576-8538-e421eddc3249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:39.554902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbb07d-b8bb-4576-8538-e421eddc3249 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.555179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbb07d-b8bb-4576-8538-e421eddc3249 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.555449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbb07d-b8bb-4576-8538-e421eddc3249 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.556653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbb07d-b8bb-4576-8538-e421eddc3249 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:39.558937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbb07d-b8bb-4576-8538-e421eddc3249 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:39.593018 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 231/469] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:19:39 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:19:39.606075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbb07d-b8bb-4576-8538-e421eddc3249 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:39.628825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:39.648692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:39.717715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba008be-c4f8-4e69-a41b-56b9a4bef5f1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:39.765692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2b9df-b5bd-40bd-8ca5-ba8859824fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:39.765903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbb07d-b8bb-4576-8538-e421eddc3249 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:39.766396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2b9df-b5bd-40bd-8ca5-ba8859824fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.766620 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2b9df-b5bd-40bd-8ca5-ba8859824fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.766893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2b9df-b5bd-40bd-8ca5-ba8859824fc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.782017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2b9df-b5bd-40bd-8ca5-ba8859824fc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:39.783485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2b9df-b5bd-40bd-8ca5-ba8859824fc4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-95b2b9df-b5bd-40bd-8ca5-ba8859824fc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:39.802373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:39.803287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:39.804131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:39.804131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:39.804131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:39.804131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 239/470] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:19:39.804772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66855772-cef5-4509-bcb9-ebaa46b668f7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.804925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66855772-cef5-4509-bcb9-ebaa46b668f7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.806525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66855772-cef5-4509-bcb9-ebaa46b668f7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.807355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 240/471] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:39.811581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66855772-cef5-4509-bcb9-ebaa46b668f7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:39.815064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d2d2a-20e6-4e5f-a08d-15f50afd70df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:39.815708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d2d2a-20e6-4e5f-a08d-15f50afd70df None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.815982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d2d2a-20e6-4e5f-a08d-15f50afd70df None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.816249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d2d2a-20e6-4e5f-a08d-15f50afd70df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.827153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d2d2a-20e6-4e5f-a08d-15f50afd70df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:39.828603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d2d2a-20e6-4e5f-a08d-15f50afd70df None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-854d2d2a-20e6-4e5f-a08d-15f50afd70df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:39.843832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:39.844753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:39.845629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:39.845629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:39.845629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:39.845786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 232/472] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:39.846909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b206d-f71a-479f-9552-8b754a8186b8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.847186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b206d-f71a-479f-9552-8b754a8186b8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.847448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b206d-f71a-479f-9552-8b754a8186b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.871727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ea3b206d-f71a-479f-9552-8b754a8186b8 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:39.872910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ea3b206d-f71a-479f-9552-8b754a8186b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:39.942372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:39.944741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66855772-cef5-4509-bcb9-ebaa46b668f7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:39.947921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:39.953399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 233/473] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:39.954579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b206d-f71a-479f-9552-8b754a8186b8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:39.985202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cbcbb-c6a2-483a-8804-b12c8f349e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:39.985844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cbcbb-c6a2-483a-8804-b12c8f349e63 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:39.986122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cbcbb-c6a2-483a-8804-b12c8f349e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:39.986391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cbcbb-c6a2-483a-8804-b12c8f349e63 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:39.987045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cbcbb-c6a2-483a-8804-b12c8f349e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:39.987506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cbcbb-c6a2-483a-8804-b12c8f349e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:39.988745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cbcbb-c6a2-483a-8804-b12c8f349e63 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:40.007673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 241/474] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:40.007673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cbcbb-c6a2-483a-8804-b12c8f349e63 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:40.114686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cbcbb-c6a2-483a-8804-b12c8f349e63 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:40.131315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b206d-f71a-479f-9552-8b754a8186b8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:40.150753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3449-42a8-408e-af6b-a9cad69a95d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:40.151368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3449-42a8-408e-af6b-a9cad69a95d8 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:40.152003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3449-42a8-408e-af6b-a9cad69a95d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:40.152282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3449-42a8-408e-af6b-a9cad69a95d8 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:40.152927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff3449-42a8-408e-af6b-a9cad69a95d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:40.154383 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff3449-42a8-408e-af6b-a9cad69a95d8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:40.183354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 242/475] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:19:40 2022] POST /identity/v3/users => generated 248 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:19:40.211463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993be154-1882-4d72-97ef-b95bfd86923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:40.212631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993be154-1882-4d72-97ef-b95bfd86923e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:40.212914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993be154-1882-4d72-97ef-b95bfd86923e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:40.213260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993be154-1882-4d72-97ef-b95bfd86923e None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:40.213903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993be154-1882-4d72-97ef-b95bfd86923e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:40.214249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993be154-1882-4d72-97ef-b95bfd86923e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:40.215663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993be154-1882-4d72-97ef-b95bfd86923e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:40.238724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 234/476] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:40.246117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3449-42a8-408e-af6b-a9cad69a95d8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:40.254736 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993be154-1882-4d72-97ef-b95bfd86923e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:40.285587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:40.344037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:40.430243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993be154-1882-4d72-97ef-b95bfd86923e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:40.438658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3449-42a8-408e-af6b-a9cad69a95d8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:40.479877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afc5dd-9965-44db-a0e7-2aeac79431da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:40.480615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc5dd-9965-44db-a0e7-2aeac79431da None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:40.480976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02abad-a6b5-4071-8755-fef1e1a26abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:40.481098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc5dd-9965-44db-a0e7-2aeac79431da None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:40.481459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afc5dd-9965-44db-a0e7-2aeac79431da None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:40.481608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02abad-a6b5-4071-8755-fef1e1a26abc None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:40.481879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02abad-a6b5-4071-8755-fef1e1a26abc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:40.482151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02abad-a6b5-4071-8755-fef1e1a26abc None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:40.482358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afc5dd-9965-44db-a0e7-2aeac79431da None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:40.482788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02abad-a6b5-4071-8755-fef1e1a26abc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:40.483873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afc5dd-9965-44db-a0e7-2aeac79431da None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:40.484302 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02abad-a6b5-4071-8755-fef1e1a26abc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:40.493059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.sql.core [None req-a7afc5dd-9965-44db-a0e7-2aeac79431da None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 10:19:40.493059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 10:19:40.493059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [parameters: {'id': '10ba2334aa7c4728abf3bec7540a52fd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 10:19:40.493059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81437) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 10:19:40.510550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 243/477] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:19:40 2022] POST /identity/v3/users => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a7afc5dd-9965-44db-a0e7-2aeac79431da None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Sep 26 10:19:40.515155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return ref.to_dict() Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 10:19:40.516246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application yield resource Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise self.value Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application session.commit() Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 10:19:40.517431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.flush() Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application compat.raise_( Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 10:19:40.518576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 10:19:40.519846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 10:19:40.520939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [parameters: {'id': '10ba2334aa7c4728abf3bec7540a52fd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:40.521759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 10:19:40.522618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:40.523418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 235/478] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Sep 26 10:19:40 2022] POST /identity/v3/roles => generated 144 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:19:40.524265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02abad-a6b5-4071-8755-fef1e1a26abc None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:40.628924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:40.654581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02abad-a6b5-4071-8755-fef1e1a26abc None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:40.692601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038e82c-b247-4a29-b025-c04830d528f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:40.693619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e82c-b247-4a29-b025-c04830d528f1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:40.694081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e82c-b247-4a29-b025-c04830d528f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:40.694547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e82c-b247-4a29-b025-c04830d528f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:40.707657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038e82c-b247-4a29-b025-c04830d528f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b038e82c-b247-4a29-b025-c04830d528f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:40.713556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:40.714636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 10:19:40.715618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:40.717971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 244/479] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:19:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:40.724377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afc5dd-9965-44db-a0e7-2aeac79431da None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:40.852198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afc5dd-9965-44db-a0e7-2aeac79431da None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:40.874134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:40.898442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d49d2f-4a61-4a6a-b58e-b31ed07c2595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:40.899034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d49d2f-4a61-4a6a-b58e-b31ed07c2595 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:40.899825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d49d2f-4a61-4a6a-b58e-b31ed07c2595 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:40.900187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d49d2f-4a61-4a6a-b58e-b31ed07c2595 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:40.901157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d49d2f-4a61-4a6a-b58e-b31ed07c2595 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:40.901462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d49d2f-4a61-4a6a-b58e-b31ed07c2595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:40.902850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d49d2f-4a61-4a6a-b58e-b31ed07c2595 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:40.911749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 236/480] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:41.960714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313fa05-474d-438a-ab5f-3a868175bcd1 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:41.961244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313fa05-474d-438a-ab5f-3a868175bcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:41.961349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313fa05-474d-438a-ab5f-3a868175bcd1 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:41.962936 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 245/481] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:41.967887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c582d-0c1e-4fdb-afa8-94374397739f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:41.968271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c582d-0c1e-4fdb-afa8-94374397739f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:41.968445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c582d-0c1e-4fdb-afa8-94374397739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:41.998454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-635c582d-0c1e-4fdb-afa8-94374397739f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:41.999650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-635c582d-0c1e-4fdb-afa8-94374397739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:42.106201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 237/482] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:42.495861 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb078dd-7caa-4be3-8517-93c9439bac01 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:42.496578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb078dd-7caa-4be3-8517-93c9439bac01 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:42.497089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb078dd-7caa-4be3-8517-93c9439bac01 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:42.498902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 246/483] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:42.505521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b3cd9-c12f-4f80-9977-5a09e463af11 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:42.506054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b3cd9-c12f-4f80-9977-5a09e463af11 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:42.506551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b3cd9-c12f-4f80-9977-5a09e463af11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:42.533969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c31b3cd9-c12f-4f80-9977-5a09e463af11 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:42.535496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c31b3cd9-c12f-4f80-9977-5a09e463af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:42.537481 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb078dd-7caa-4be3-8517-93c9439bac01 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:42.614337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 238/484] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:42.714261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb078dd-7caa-4be3-8517-93c9439bac01 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:42.759459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaac20-8cd5-4412-bbcf-b4dffe32d919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:42.760080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaac20-8cd5-4412-bbcf-b4dffe32d919 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:42.760354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaac20-8cd5-4412-bbcf-b4dffe32d919 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:42.760619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaac20-8cd5-4412-bbcf-b4dffe32d919 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:42.763427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:42.777834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdaac20-8cd5-4412-bbcf-b4dffe32d919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1cdaac20-8cd5-4412-bbcf-b4dffe32d919 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:42.782651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:42.783519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:42.784352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 247/485] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:19:42.791874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b3cd9-c12f-4f80-9977-5a09e463af11 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:42.847789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:42.909377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b3cd9-c12f-4f80-9977-5a09e463af11 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:42.951025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61b26-74e4-4fc1-a04c-4aa2dbeed533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:42.951740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61b26-74e4-4fc1-a04c-4aa2dbeed533 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:42.952028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61b26-74e4-4fc1-a04c-4aa2dbeed533 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:42.952302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61b26-74e4-4fc1-a04c-4aa2dbeed533 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:42.953021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61b26-74e4-4fc1-a04c-4aa2dbeed533 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:42.953328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61b26-74e4-4fc1-a04c-4aa2dbeed533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:42.954772 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61b26-74e4-4fc1-a04c-4aa2dbeed533 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:42.964699 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 239/486] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:42.970886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaac20-8cd5-4412-bbcf-b4dffe32d919 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:43.025078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61b26-74e4-4fc1-a04c-4aa2dbeed533 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:43.133252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaac20-8cd5-4412-bbcf-b4dffe32d919 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:43.153591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61b26-74e4-4fc1-a04c-4aa2dbeed533 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:43.156622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:43.178315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fb2f9-f85d-458e-afa3-14a3084fd666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:43.179218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fb2f9-f85d-458e-afa3-14a3084fd666 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.179501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fb2f9-f85d-458e-afa3-14a3084fd666 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.179767 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fb2f9-f85d-458e-afa3-14a3084fd666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.188670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724505ff-d3e9-4b0f-ba54-a5d5ab32c4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:43.189327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724505ff-d3e9-4b0f-ba54-a5d5ab32c4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.189602 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724505ff-d3e9-4b0f-ba54-a5d5ab32c4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.189868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724505ff-d3e9-4b0f-ba54-a5d5ab32c4b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.191581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fb2f9-f85d-458e-afa3-14a3084fd666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:43.193216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fb2f9-f85d-458e-afa3-14a3084fd666 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:43.200478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724505ff-d3e9-4b0f-ba54-a5d5ab32c4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-724505ff-d3e9-4b0f-ba54-a5d5ab32c4b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:43.205877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:43.206740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:43.207515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 240/487] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:19:43.210145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152763a-def2-474e-96d0-a300decaf9bf None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.210632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152763a-def2-474e-96d0-a300decaf9bf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.211097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152763a-def2-474e-96d0-a300decaf9bf None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-dd4fb2f9-f85d-458e-afa3-14a3084fd666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:43.211489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:43.212371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:43.213217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:43.213217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:43.213217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:43.213217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 248/488] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:43.214153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad625331-b967-457f-875b-92441340ce0b None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.214441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad625331-b967-457f-875b-92441340ce0b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.214769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad625331-b967-457f-875b-92441340ce0b None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.219636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 241/489] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:43 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:43.220107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 249/490] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:43.220622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152763a-def2-474e-96d0-a300decaf9bf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:43.220874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad625331-b967-457f-875b-92441340ce0b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:43.276219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:43.328405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152763a-def2-474e-96d0-a300decaf9bf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:43.332753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad625331-b967-457f-875b-92441340ce0b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:43.363514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4ced2-430f-418c-94f6-424100fa2747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:43.364132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ced2-430f-418c-94f6-424100fa2747 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.364427 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ced2-430f-418c-94f6-424100fa2747 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.364694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ced2-430f-418c-94f6-424100fa2747 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.365393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4ced2-430f-418c-94f6-424100fa2747 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:43.365701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4ced2-430f-418c-94f6-424100fa2747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:43.367091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4ced2-430f-418c-94f6-424100fa2747 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:43.373812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440e5b3-ed8a-4c6f-abb8-40f3a5e9bfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:43.374425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e5b3-ed8a-4c6f-abb8-40f3a5e9bfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.375017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e5b3-ed8a-4c6f-abb8-40f3a5e9bfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.375304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e5b3-ed8a-4c6f-abb8-40f3a5e9bfe2 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.375946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e5b3-ed8a-4c6f-abb8-40f3a5e9bfe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:43.376251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e5b3-ed8a-4c6f-abb8-40f3a5e9bfe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:43.376868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 242/491] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:43.377617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e5b3-ed8a-4c6f-abb8-40f3a5e9bfe2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:43.382524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751c4f9-7c51-45ca-b011-0ce6c3dce2d7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.382820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751c4f9-7c51-45ca-b011-0ce6c3dce2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.383098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751c4f9-7c51-45ca-b011-0ce6c3dce2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.393543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 250/492] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:43.393543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f439b-7407-4327-b44f-536f0a7bd536 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.393543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f439b-7407-4327-b44f-536f0a7bd536 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.393543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f439b-7407-4327-b44f-536f0a7bd536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.409348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b751c4f9-7c51-45ca-b011-0ce6c3dce2d7 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:43.409515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-391f439b-7407-4327-b44f-536f0a7bd536 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:43.410559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b751c4f9-7c51-45ca-b011-0ce6c3dce2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:43.410658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-391f439b-7407-4327-b44f-536f0a7bd536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:43.434167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:43.482823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 251/493] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:43.483953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f439b-7407-4327-b44f-536f0a7bd536 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:43.487810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 243/494] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:43.488683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751c4f9-7c51-45ca-b011-0ce6c3dce2d7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:43.533312 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:43.593711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f439b-7407-4327-b44f-536f0a7bd536 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:43.628831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107fe33-aaa4-424b-ae73-e7eeb9d284cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:43.629844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107fe33-aaa4-424b-ae73-e7eeb9d284cc None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.630399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107fe33-aaa4-424b-ae73-e7eeb9d284cc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.630871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107fe33-aaa4-424b-ae73-e7eeb9d284cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.641980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107fe33-aaa4-424b-ae73-e7eeb9d284cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:43.643684 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107fe33-aaa4-424b-ae73-e7eeb9d284cc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b107fe33-aaa4-424b-ae73-e7eeb9d284cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:43.659251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:43.660150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:43.660994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:43.660994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:43.660994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:43.663019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 252/495] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:43.670251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107fe33-aaa4-424b-ae73-e7eeb9d284cc None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:43.690421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751c4f9-7c51-45ca-b011-0ce6c3dce2d7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:43.740487 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b85ca6-ca03-4580-96bc-be77dc9655cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:43.742359 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85ca6-ca03-4580-96bc-be77dc9655cc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.744232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85ca6-ca03-4580-96bc-be77dc9655cc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.744684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85ca6-ca03-4580-96bc-be77dc9655cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.761281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b85ca6-ca03-4580-96bc-be77dc9655cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:43.762991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b85ca6-ca03-4580-96bc-be77dc9655cc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-78b85ca6-ca03-4580-96bc-be77dc9655cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:43.783278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:43.784226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:43.785120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:43.785120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:43.785120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:43.785120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:43.785120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:43.785120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:43.785120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:43.785120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:43.785120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:19:43.785120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:43.788881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 244/496] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 10:19:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:43.789722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b85ca6-ca03-4580-96bc-be77dc9655cc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:43.809094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:43.833316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:43.845688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107fe33-aaa4-424b-ae73-e7eeb9d284cc None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:43.883153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a6a8-8ea0-4058-8b33-e740ef505d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:43.883842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a6a8-8ea0-4058-8b33-e740ef505d30 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.884124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a6a8-8ea0-4058-8b33-e740ef505d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.884398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1a6a8-8ea0-4058-8b33-e740ef505d30 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.885078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a6a8-8ea0-4058-8b33-e740ef505d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:43.885386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a6a8-8ea0-4058-8b33-e740ef505d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:43.887886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1a6a8-8ea0-4058-8b33-e740ef505d30 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:43.895189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b85ca6-ca03-4580-96bc-be77dc9655cc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:43.903213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 253/497] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:43.903877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a6a8-8ea0-4058-8b33-e740ef505d30 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:43.930781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956cd05-fda5-48c2-9586-fe5a51ea3c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:43.931411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cd05-fda5-48c2-9586-fe5a51ea3c5b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.931692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cd05-fda5-48c2-9586-fe5a51ea3c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.931965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cd05-fda5-48c2-9586-fe5a51ea3c5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.941910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956cd05-fda5-48c2-9586-fe5a51ea3c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c956cd05-fda5-48c2-9586-fe5a51ea3c5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:43.947170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:43.948004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:43.948763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 245/498] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:43.949518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c617de-1aab-4818-b5a2-901e43d9d3bb None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:43.949636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c617de-1aab-4818-b5a2-901e43d9d3bb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:43.950156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c617de-1aab-4818-b5a2-901e43d9d3bb None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:43.951251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 246/499] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:43.951781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c617de-1aab-4818-b5a2-901e43d9d3bb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.006765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1a6a8-8ea0-4058-8b33-e740ef505d30 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.029554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:44.041968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d9d6b-b646-4664-ad21-a66825b72b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.042560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9d6b-b646-4664-ad21-a66825b72b1c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.042835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9d6b-b646-4664-ad21-a66825b72b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.043107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9d6b-b646-4664-ad21-a66825b72b1c None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.043817 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d9d6b-b646-4664-ad21-a66825b72b1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:44.044118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d9d6b-b646-4664-ad21-a66825b72b1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:44.045560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d9d6b-b646-4664-ad21-a66825b72b1c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:44.053060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c617de-1aab-4818-b5a2-901e43d9d3bb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.080382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 254/500] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 10:19:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:44.081448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d9d6b-b646-4664-ad21-a66825b72b1c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.088756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1756e13-33e7-4612-a234-b995aa967b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.089412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1756e13-33e7-4612-a234-b995aa967b2f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.089690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1756e13-33e7-4612-a234-b995aa967b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.089960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1756e13-33e7-4612-a234-b995aa967b2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.093060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:44.100016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1756e13-33e7-4612-a234-b995aa967b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d1756e13-33e7-4612-a234-b995aa967b2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:44.105872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:44.106738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:44.107506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 247/501] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:44.108138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1756e13-33e7-4612-a234-b995aa967b2f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.182004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d9d6b-b646-4664-ad21-a66825b72b1c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.210377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1756e13-33e7-4612-a234-b995aa967b2f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.217993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0622b-2784-4b31-9821-f4719dad8b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.218628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0622b-2784-4b31-9821-f4719dad8b89 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.218910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0622b-2784-4b31-9821-f4719dad8b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.219184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0622b-2784-4b31-9821-f4719dad8b89 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.226080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0622b-2784-4b31-9821-f4719dad8b89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:44.228016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0622b-2784-4b31-9821-f4719dad8b89 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-67c0622b-2784-4b31-9821-f4719dad8b89 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:44.240580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:44.241564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:44.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 255/502] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:44.243005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7285c-0566-41be-8ac7-f0f9ca5d048f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.243753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7285c-0566-41be-8ac7-f0f9ca5d048f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.244026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7285c-0566-41be-8ac7-f0f9ca5d048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.249985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce0f0e-f356-4615-8787-85445668b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.250589 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce0f0e-f356-4615-8787-85445668b696 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.250865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce0f0e-f356-4615-8787-85445668b696 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.251132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce0f0e-f356-4615-8787-85445668b696 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.251789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce0f0e-f356-4615-8787-85445668b696 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:44.252086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce0f0e-f356-4615-8787-85445668b696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:44.253473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce0f0e-f356-4615-8787-85445668b696 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:44.255731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:44.261549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7fe7285c-0566-41be-8ac7-f0f9ca5d048f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:44.262678 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7fe7285c-0566-41be-8ac7-f0f9ca5d048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:44.262786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 248/503] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:44.263534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce0f0e-f356-4615-8787-85445668b696 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.324900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:44.330568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 256/504] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:44.331430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7285c-0566-41be-8ac7-f0f9ca5d048f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.383166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce0f0e-f356-4615-8787-85445668b696 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.419208 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dbb27-0101-4fab-82e9-297b9094c8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.419810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dbb27-0101-4fab-82e9-297b9094c8cb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.420105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dbb27-0101-4fab-82e9-297b9094c8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.420379 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dbb27-0101-4fab-82e9-297b9094c8cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.435251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7285c-0566-41be-8ac7-f0f9ca5d048f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.474246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e06c6-b8b5-424d-8b18-472c276ba7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.474862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e06c6-b8b5-424d-8b18-472c276ba7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.475147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e06c6-b8b5-424d-8b18-472c276ba7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.475423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e06c6-b8b5-424d-8b18-472c276ba7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.476092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e06c6-b8b5-424d-8b18-472c276ba7e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:44.476400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e06c6-b8b5-424d-8b18-472c276ba7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:44.478388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e06c6-b8b5-424d-8b18-472c276ba7e3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:44.487861 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:44.488730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 257/505] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:44.489677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e06c6-b8b5-424d-8b18-472c276ba7e3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.497926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dbb27-0101-4fab-82e9-297b9094c8cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:44.500163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dbb27-0101-4fab-82e9-297b9094c8cb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:44.551864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:44.594317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e06c6-b8b5-424d-8b18-472c276ba7e3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.606633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 249/506] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:44.607715 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dbb27-0101-4fab-82e9-297b9094c8cb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.633020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637a4e-c609-48a6-ae18-35830d6961a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.633812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637a4e-c609-48a6-ae18-35830d6961a6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.634103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637a4e-c609-48a6-ae18-35830d6961a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.634372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637a4e-c609-48a6-ae18-35830d6961a6 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.635095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e637a4e-c609-48a6-ae18-35830d6961a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:44.635397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e637a4e-c609-48a6-ae18-35830d6961a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:44.636976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e637a4e-c609-48a6-ae18-35830d6961a6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:44.654288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 258/507] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:44.655077 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637a4e-c609-48a6-ae18-35830d6961a6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.702058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:44.706243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dbb27-0101-4fab-82e9-297b9094c8cb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.740266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7050b-bc4b-46b0-b702-9492835927ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.740884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7050b-bc4b-46b0-b702-9492835927ee None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.741194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7050b-bc4b-46b0-b702-9492835927ee None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.741480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7050b-bc4b-46b0-b702-9492835927ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.751818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7050b-bc4b-46b0-b702-9492835927ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:44.752933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637a4e-c609-48a6-ae18-35830d6961a6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.753363 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7050b-bc4b-46b0-b702-9492835927ee None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0ed7050b-bc4b-46b0-b702-9492835927ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:44.767987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:44.768922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:44.770269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:44.770269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:44.770269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:44.770269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 250/508] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:44.770269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7050b-bc4b-46b0-b702-9492835927ee None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.775095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:44.795313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354234ff-af25-40bc-a25b-5c32ecc859ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.796111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354234ff-af25-40bc-a25b-5c32ecc859ae None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.796392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354234ff-af25-40bc-a25b-5c32ecc859ae None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.796666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354234ff-af25-40bc-a25b-5c32ecc859ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.809232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354234ff-af25-40bc-a25b-5c32ecc859ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:44.810601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354234ff-af25-40bc-a25b-5c32ecc859ae None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-354234ff-af25-40bc-a25b-5c32ecc859ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:44.825668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:44.826556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:44.827382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:44.827382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:44.827382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:44.827382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 259/509] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:44.827595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354234ff-af25-40bc-a25b-5c32ecc859ae None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.874230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7050b-bc4b-46b0-b702-9492835927ee None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.907671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096cc99-ccac-4b72-abaf-1289bd74f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.908286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096cc99-ccac-4b72-abaf-1289bd74f706 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.908561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096cc99-ccac-4b72-abaf-1289bd74f706 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.908830 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096cc99-ccac-4b72-abaf-1289bd74f706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.918990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096cc99-ccac-4b72-abaf-1289bd74f706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:44.920495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096cc99-ccac-4b72-abaf-1289bd74f706 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:44.922923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354234ff-af25-40bc-a25b-5c32ecc859ae None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e096cc99-ccac-4b72-abaf-1289bd74f706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:44.935046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:44.936114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:44.936964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:44.936964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:44.936964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:44.936964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 251/510] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:44.936964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096cc99-ccac-4b72-abaf-1289bd74f706 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:44.939838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:44.959716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd9c4-3c55-44c0-9801-98444cb7deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:44.960344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd9c4-3c55-44c0-9801-98444cb7deb7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:44.960632 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd9c4-3c55-44c0-9801-98444cb7deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:44.960905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd9c4-3c55-44c0-9801-98444cb7deb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:44.971411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fd9c4-3c55-44c0-9801-98444cb7deb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:44.972849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fd9c4-3c55-44c0-9801-98444cb7deb7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-373fd9c4-3c55-44c0-9801-98444cb7deb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:44.987342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:44.988243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:44.989099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:44.989099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:44.989099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:44.989099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 260/511] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:44.989318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd9c4-3c55-44c0-9801-98444cb7deb7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.016084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:45.040850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096cc99-ccac-4b72-abaf-1289bd74f706 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.073315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c69e0-b437-46d5-95af-8d478a481f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.073853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c69e0-b437-46d5-95af-8d478a481f8d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.074127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c69e0-b437-46d5-95af-8d478a481f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.074401 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c69e0-b437-46d5-95af-8d478a481f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.089929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd9c4-3c55-44c0-9801-98444cb7deb7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.123068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8502573-34a8-4821-bcff-f662b8423529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.123888 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8502573-34a8-4821-bcff-f662b8423529 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.124160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8502573-34a8-4821-bcff-f662b8423529 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.124431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8502573-34a8-4821-bcff-f662b8423529 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.125267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8502573-34a8-4821-bcff-f662b8423529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:45.125576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8502573-34a8-4821-bcff-f662b8423529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.126940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8502573-34a8-4821-bcff-f662b8423529 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.140183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 261/512] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:45.141022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8502573-34a8-4821-bcff-f662b8423529 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.143059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c69e0-b437-46d5-95af-8d478a481f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.145761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c69e0-b437-46d5-95af-8d478a481f8d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.149240 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:45.225143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:45.243054 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8502573-34a8-4821-bcff-f662b8423529 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.251854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 252/513] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:45.252689 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c69e0-b437-46d5-95af-8d478a481f8d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.277922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec24d6-269a-483c-8663-d191bf6254b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.278521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec24d6-269a-483c-8663-d191bf6254b8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.278798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec24d6-269a-483c-8663-d191bf6254b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.279066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec24d6-269a-483c-8663-d191bf6254b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.279700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec24d6-269a-483c-8663-d191bf6254b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:45.279999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec24d6-269a-483c-8663-d191bf6254b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.281385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec24d6-269a-483c-8663-d191bf6254b8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.292218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 262/514] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:45.293026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec24d6-269a-483c-8663-d191bf6254b8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.350322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c69e0-b437-46d5-95af-8d478a481f8d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.352057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:45.386803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f74c-e743-48e5-ae8c-0dee869c143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.387405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f74c-e743-48e5-ae8c-0dee869c143e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.387683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f74c-e743-48e5-ae8c-0dee869c143e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.387957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f74c-e743-48e5-ae8c-0dee869c143e None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.388617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f74c-e743-48e5-ae8c-0dee869c143e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:45.388922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f74c-e743-48e5-ae8c-0dee869c143e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.390112 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec24d6-269a-483c-8663-d191bf6254b8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.390304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f74c-e743-48e5-ae8c-0dee869c143e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.401779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 253/515] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:45.402552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f74c-e743-48e5-ae8c-0dee869c143e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.423907 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15e655-b155-4103-8690-a31f95a90ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.424513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15e655-b155-4103-8690-a31f95a90ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.424796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15e655-b155-4103-8690-a31f95a90ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.425101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15e655-b155-4103-8690-a31f95a90ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.425737 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15e655-b155-4103-8690-a31f95a90ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:45.426042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15e655-b155-4103-8690-a31f95a90ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.427576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15e655-b155-4103-8690-a31f95a90ce6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.439841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 263/516] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:45.440620 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15e655-b155-4103-8690-a31f95a90ce6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.443104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:45.503839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f74c-e743-48e5-ae8c-0dee869c143e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.537340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4190a-dace-415d-b335-26568ef55b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.537965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4190a-dace-415d-b335-26568ef55b22 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.538243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4190a-dace-415d-b335-26568ef55b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.538513 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4190a-dace-415d-b335-26568ef55b22 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.538624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15e655-b155-4103-8690-a31f95a90ce6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.545733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4190a-dace-415d-b335-26568ef55b22 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.547158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4190a-dace-415d-b335-26568ef55b22 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-efa4190a-dace-415d-b335-26568ef55b22 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:45.558442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:45.559459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 254/517] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:45.560357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4190a-dace-415d-b335-26568ef55b22 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.572622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43e235-e077-49dc-9689-04011e9767f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.573277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43e235-e077-49dc-9689-04011e9767f2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.573559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43e235-e077-49dc-9689-04011e9767f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.573831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43e235-e077-49dc-9689-04011e9767f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.583642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43e235-e077-49dc-9689-04011e9767f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.585113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43e235-e077-49dc-9689-04011e9767f2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.587128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-dd43e235-e077-49dc-9689-04011e9767f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:45.601128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:45.602005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:45.602858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:45.602858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:45.602858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:45.602858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 264/518] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:45.603382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43e235-e077-49dc-9689-04011e9767f2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.660223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:45.662337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4190a-dace-415d-b335-26568ef55b22 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.694756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5f7e9-9cf3-4c22-a613-0063b733b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.695375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5f7e9-9cf3-4c22-a613-0063b733b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.695656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5f7e9-9cf3-4c22-a613-0063b733b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.695924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5f7e9-9cf3-4c22-a613-0063b733b3b4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.703203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43e235-e077-49dc-9689-04011e9767f2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.704330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5f7e9-9cf3-4c22-a613-0063b733b3b4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.705809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5f7e9-9cf3-4c22-a613-0063b733b3b4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f4f5f7e9-9cf3-4c22-a613-0063b733b3b4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:45.716618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:45.717535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 255/519] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:45.718398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5f7e9-9cf3-4c22-a613-0063b733b3b4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.740758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03558c5a-14e5-444d-a123-2a6d56e5de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.741435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558c5a-14e5-444d-a123-2a6d56e5de6b None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.741717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558c5a-14e5-444d-a123-2a6d56e5de6b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.741991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558c5a-14e5-444d-a123-2a6d56e5de6b None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.742627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03558c5a-14e5-444d-a123-2a6d56e5de6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.744132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03558c5a-14e5-444d-a123-2a6d56e5de6b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.764694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 265/520] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:19:45 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:19:45.765560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03558c5a-14e5-444d-a123-2a6d56e5de6b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.821667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:45.842499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5f7e9-9cf3-4c22-a613-0063b733b3b4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.878283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa990d08-64c3-485f-88af-f8b08dcb8794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.878820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa990d08-64c3-485f-88af-f8b08dcb8794 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.879103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa990d08-64c3-485f-88af-f8b08dcb8794 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.879375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa990d08-64c3-485f-88af-f8b08dcb8794 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.880921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03558c5a-14e5-444d-a123-2a6d56e5de6b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:45.887253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa990d08-64c3-485f-88af-f8b08dcb8794 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.888729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa990d08-64c3-485f-88af-f8b08dcb8794 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.893564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-aa990d08-64c3-485f-88af-f8b08dcb8794 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:45.902335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:45.903236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:45.904211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:45.904211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:45.904211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:45.904211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:45.904211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:45.904211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:45.904211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:45.904211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:45.904211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 256/521] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:45.905307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa990d08-64c3-485f-88af-f8b08dcb8794 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:45.927859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920864d7-45ef-4ce0-a030-c5024140c668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:45.928980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920864d7-45ef-4ce0-a030-c5024140c668 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:45.929268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920864d7-45ef-4ce0-a030-c5024140c668 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:45.929542 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920864d7-45ef-4ce0-a030-c5024140c668 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:45.930433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920864d7-45ef-4ce0-a030-c5024140c668 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:45.930854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920864d7-45ef-4ce0-a030-c5024140c668 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:45.932845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920864d7-45ef-4ce0-a030-c5024140c668 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:45.951513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 266/522] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 10:19:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:45.952406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920864d7-45ef-4ce0-a030-c5024140c668 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:46.024289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa990d08-64c3-485f-88af-f8b08dcb8794 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:46.059652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920864d7-45ef-4ce0-a030-c5024140c668 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:46.062906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28138a-8160-4d86-ba2c-3a0b2a28463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:46.063587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28138a-8160-4d86-ba2c-3a0b2a28463a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:46.063933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28138a-8160-4d86-ba2c-3a0b2a28463a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:46.064275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28138a-8160-4d86-ba2c-3a0b2a28463a None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:46.065016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28138a-8160-4d86-ba2c-3a0b2a28463a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:46.065393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28138a-8160-4d86-ba2c-3a0b2a28463a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:46.066947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28138a-8160-4d86-ba2c-3a0b2a28463a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:46.080090 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 257/523] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:46.081100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28138a-8160-4d86-ba2c-3a0b2a28463a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:46.083697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:46.097772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe923-3297-46da-a02c-687cd2815e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:46.098382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe923-3297-46da-a02c-687cd2815e53 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:46.098660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe923-3297-46da-a02c-687cd2815e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:46.098929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe923-3297-46da-a02c-687cd2815e53 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:46.099653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe923-3297-46da-a02c-687cd2815e53 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:46.099956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe923-3297-46da-a02c-687cd2815e53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:46.101423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe923-3297-46da-a02c-687cd2815e53 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:46.118953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 267/524] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Sep 26 10:19:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:46.119770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe923-3297-46da-a02c-687cd2815e53 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:46.149706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:46.195782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28138a-8160-4d86-ba2c-3a0b2a28463a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:46.228455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe923-3297-46da-a02c-687cd2815e53 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:46.231204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13199fc-f6df-49ec-8d66-db0efc39d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:46.231822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13199fc-f6df-49ec-8d66-db0efc39d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:46.232102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13199fc-f6df-49ec-8d66-db0efc39d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:46.232373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13199fc-f6df-49ec-8d66-db0efc39d8d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:46.233085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13199fc-f6df-49ec-8d66-db0efc39d8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:46.233392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13199fc-f6df-49ec-8d66-db0efc39d8d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:46.234816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13199fc-f6df-49ec-8d66-db0efc39d8d1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:46.258009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 258/525] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:46.258009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13199fc-f6df-49ec-8d66-db0efc39d8d1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:46.271647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f9541-2b8e-4098-b649-2a101fca3091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:46.272260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f9541-2b8e-4098-b649-2a101fca3091 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:46.272535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f9541-2b8e-4098-b649-2a101fca3091 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:46.272970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f9541-2b8e-4098-b649-2a101fca3091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:46.324303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:46.343079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f9541-2b8e-4098-b649-2a101fca3091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:46.344515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f9541-2b8e-4098-b649-2a101fca3091 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:46.371896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13199fc-f6df-49ec-8d66-db0efc39d8d1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:46.376235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:46.408064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afc6ff-6db6-4761-a5da-8a06323095a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:46.408612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc6ff-6db6-4761-a5da-8a06323095a8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:46.408894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc6ff-6db6-4761-a5da-8a06323095a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:46.409209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc6ff-6db6-4761-a5da-8a06323095a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:46.415759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afc6ff-6db6-4761-a5da-8a06323095a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:46.417239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afc6ff-6db6-4761-a5da-8a06323095a8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a8afc6ff-6db6-4761-a5da-8a06323095a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:46.429276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:46.430312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:46.431778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:46.431778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:46.431778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:46.431778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:46.431778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:46.431778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:46.431778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:46.431778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:46.431778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 259/526] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:46.431778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afc6ff-6db6-4761-a5da-8a06323095a8 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:46.465451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 268/527] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:46.466621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f9541-2b8e-4098-b649-2a101fca3091 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:46.542972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afc6ff-6db6-4761-a5da-8a06323095a8 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:46.565635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:46.576973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f9541-2b8e-4098-b649-2a101fca3091 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:46.580461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54abdb8-21b4-4783-9714-48f3bde9c7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:46.581119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54abdb8-21b4-4783-9714-48f3bde9c7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:46.581399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54abdb8-21b4-4783-9714-48f3bde9c7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:46.581669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54abdb8-21b4-4783-9714-48f3bde9c7e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:46.605138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:46.615616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a77f4-8156-4320-a607-5ebf07921973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:46.616274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a77f4-8156-4320-a607-5ebf07921973 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:46.616561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a77f4-8156-4320-a607-5ebf07921973 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:46.616836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a77f4-8156-4320-a607-5ebf07921973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:46.617618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a77f4-8156-4320-a607-5ebf07921973 None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=e58300ef26a547028e837ba2da615991) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:46.617964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a77f4-8156-4320-a607-5ebf07921973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:46.619482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a77f4-8156-4320-a607-5ebf07921973 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:46.625141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 269/528] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:46 2022] GET /identity/v3/role_assignments?user.id=e58300ef26a547028e837ba2da615991&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:46.626216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a77f4-8156-4320-a607-5ebf07921973 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:46.656081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54abdb8-21b4-4783-9714-48f3bde9c7e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:46.657920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54abdb8-21b4-4783-9714-48f3bde9c7e0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:46.769197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a77f4-8156-4320-a607-5ebf07921973 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:46.784831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 260/529] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:46.784831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54abdb8-21b4-4783-9714-48f3bde9c7e0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:46.819284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:46.819626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9697c1-bafe-4eae-bd20-e038ca1c26e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:46.821144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9697c1-bafe-4eae-bd20-e038ca1c26e4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:46.822280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9697c1-bafe-4eae-bd20-e038ca1c26e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:46.822563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9697c1-bafe-4eae-bd20-e038ca1c26e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:46.823279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9697c1-bafe-4eae-bd20-e038ca1c26e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:46.823591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9697c1-bafe-4eae-bd20-e038ca1c26e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:46.825045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9697c1-bafe-4eae-bd20-e038ca1c26e4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:46.848789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 270/530] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:46.850181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9697c1-bafe-4eae-bd20-e038ca1c26e4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:46.907079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:46.927470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54abdb8-21b4-4783-9714-48f3bde9c7e0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:46.962996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9697c1-bafe-4eae-bd20-e038ca1c26e4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:46.972168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d28de-6de0-488c-b40a-f2c793199fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:46.972815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d28de-6de0-488c-b40a-f2c793199fef None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:46.973155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d28de-6de0-488c-b40a-f2c793199fef None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:46.973432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d28de-6de0-488c-b40a-f2c793199fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:46.986916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d28de-6de0-488c-b40a-f2c793199fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:46.989179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d28de-6de0-488c-b40a-f2c793199fef None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:47.003238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fc92b-85ee-449f-9502-046c4e2cf1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:47.004204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fc92b-85ee-449f-9502-046c4e2cf1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:47.004686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fc92b-85ee-449f-9502-046c4e2cf1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:47.005228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fc92b-85ee-449f-9502-046c4e2cf1f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8b0d28de-6de0-488c-b40a-f2c793199fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:47.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:47.009770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:47.011178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:47.011178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:47.011178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:47.011178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 261/531] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:47.011178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d28de-6de0-488c-b40a-f2c793199fef None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:47.019732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fc92b-85ee-449f-9502-046c4e2cf1f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:47.021648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fc92b-85ee-449f-9502-046c4e2cf1f7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a82fc92b-85ee-449f-9502-046c4e2cf1f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:47.039326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:47.040893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:47.041739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:47.041739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:47.041739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:47.043946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 271/532] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:47.045062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fc92b-85ee-449f-9502-046c4e2cf1f7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:47.112741 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:47.142913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d28de-6de0-488c-b40a-f2c793199fef None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:47.160799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fc92b-85ee-449f-9502-046c4e2cf1f7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:47.163031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:47.187327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909470-9577-428a-97df-c1d043d8a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:47.187938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909470-9577-428a-97df-c1d043d8a98e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:47.188221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909470-9577-428a-97df-c1d043d8a98e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:47.188498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909470-9577-428a-97df-c1d043d8a98e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:47.189264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43909470-9577-428a-97df-c1d043d8a98e None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=dcfef506919f4914a7883bd99ea07615) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:47.189576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43909470-9577-428a-97df-c1d043d8a98e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:47.191562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43909470-9577-428a-97df-c1d043d8a98e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:47.199687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 262/533] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:47 2022] GET /identity/v3/role_assignments?user.id=dcfef506919f4914a7883bd99ea07615&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:47.200769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909470-9577-428a-97df-c1d043d8a98e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:47.210113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded9a55-b3c8-473c-9c74-1a4befcac951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:47.212480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded9a55-b3c8-473c-9c74-1a4befcac951 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:47.213022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded9a55-b3c8-473c-9c74-1a4befcac951 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:47.213516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded9a55-b3c8-473c-9c74-1a4befcac951 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:47.214846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded9a55-b3c8-473c-9c74-1a4befcac951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:47.215371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded9a55-b3c8-473c-9c74-1a4befcac951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:47.217780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded9a55-b3c8-473c-9c74-1a4befcac951 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:47.234760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 272/534] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:47.242111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded9a55-b3c8-473c-9c74-1a4befcac951 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:47.391336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909470-9577-428a-97df-c1d043d8a98e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:47.445187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded9a55-b3c8-473c-9c74-1a4befcac951 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:47.449592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb9bd-9c49-4cec-9a72-1067cc997138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:47.450462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb9bd-9c49-4cec-9a72-1067cc997138 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:47.450961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb9bd-9c49-4cec-9a72-1067cc997138 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:47.452224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb9bd-9c49-4cec-9a72-1067cc997138 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:47.453223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bb9bd-9c49-4cec-9a72-1067cc997138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:47.453729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bb9bd-9c49-4cec-9a72-1067cc997138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:47.455420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bb9bd-9c49-4cec-9a72-1067cc997138 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:47.468938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 263/535] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:47.469314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:47.477001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb9bd-9c49-4cec-9a72-1067cc997138 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:47.507660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f8da7-8d78-4d0b-852e-1d9edda080af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:47.508303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f8da7-8d78-4d0b-852e-1d9edda080af None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:47.509123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f8da7-8d78-4d0b-852e-1d9edda080af None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:47.509461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f8da7-8d78-4d0b-852e-1d9edda080af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:47.523436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f8da7-8d78-4d0b-852e-1d9edda080af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:47.525092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f8da7-8d78-4d0b-852e-1d9edda080af None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1f3f8da7-8d78-4d0b-852e-1d9edda080af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:47.546694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:47.547777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:47.548810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:47.548810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:47.548810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:47.548810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:47.548810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:47.548810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:47.548810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:47.548810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:47.557336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 273/536] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:47.558224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f8da7-8d78-4d0b-852e-1d9edda080af None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:47.596239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb9bd-9c49-4cec-9a72-1067cc997138 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:47.601652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:47.681676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f8da7-8d78-4d0b-852e-1d9edda080af None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:47.705670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b0b95-eb31-4f00-ab2e-1d027f5279bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:47.706483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b0b95-eb31-4f00-ab2e-1d027f5279bc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:47.706593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b0b95-eb31-4f00-ab2e-1d027f5279bc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:47.706852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b0b95-eb31-4f00-ab2e-1d027f5279bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:47.718036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bf1a4-e466-4e2b-a916-d3e8e9000cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:47.719016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bf1a4-e466-4e2b-a916-d3e8e9000cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:47.719497 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bf1a4-e466-4e2b-a916-d3e8e9000cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:47.720011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bf1a4-e466-4e2b-a916-d3e8e9000cf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:47.720914 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bf1a4-e466-4e2b-a916-d3e8e9000cf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:47.721437 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bf1a4-e466-4e2b-a916-d3e8e9000cf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:47.723120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bf1a4-e466-4e2b-a916-d3e8e9000cf2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:47.729715 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b0b95-eb31-4f00-ab2e-1d027f5279bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:47.731163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b0b95-eb31-4f00-ab2e-1d027f5279bc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:47.736224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 274/537] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:47.743448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bf1a4-e466-4e2b-a916-d3e8e9000cf2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6e3b0b95-eb31-4f00-ab2e-1d027f5279bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:47.761708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:47.762593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:47.763398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:47.763398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:47.763398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:47.763398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:47.763398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:47.763398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:47.763398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:47.763398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:47.768735 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 264/538] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:47.776564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b0b95-eb31-4f00-ab2e-1d027f5279bc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:47.859928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:47.876225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bf1a4-e466-4e2b-a916-d3e8e9000cf2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:47.887345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:47.920898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048a6c-ae57-4e4f-bd3f-cd8d269db8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:47.921894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048a6c-ae57-4e4f-bd3f-cd8d269db8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:47.922824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048a6c-ae57-4e4f-bd3f-cd8d269db8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:47.923897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048a6c-ae57-4e4f-bd3f-cd8d269db8c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:47.924826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49048a6c-ae57-4e4f-bd3f-cd8d269db8c8 None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=561dd954e4184662b33ca3356aa08d15) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:47.925387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49048a6c-ae57-4e4f-bd3f-cd8d269db8c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:47.927396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49048a6c-ae57-4e4f-bd3f-cd8d269db8c8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:47.934844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 275/539] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:47 2022] GET /identity/v3/role_assignments?user.id=561dd954e4184662b33ca3356aa08d15&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:47.966548 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b0b95-eb31-4f00-ab2e-1d027f5279bc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:48.024741 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fca46-b62f-4887-b005-67fcfdcfdb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:48.025397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fca46-b62f-4887-b005-67fcfdcfdb61 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:48.025935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fca46-b62f-4887-b005-67fcfdcfdb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:48.026211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fca46-b62f-4887-b005-67fcfdcfdb61 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:48.026913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fca46-b62f-4887-b005-67fcfdcfdb61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:48.027222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fca46-b62f-4887-b005-67fcfdcfdb61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:48.028657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fca46-b62f-4887-b005-67fcfdcfdb61 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:48.046470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 265/540] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:48.052292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048a6c-ae57-4e4f-bd3f-cd8d269db8c8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:48.112419 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7fa8d-efc7-424a-adf8-07d0fa400ea4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:48.112768 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7fa8d-efc7-424a-adf8-07d0fa400ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:48.112992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7fa8d-efc7-424a-adf8-07d0fa400ea4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:48.114823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 266/541] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:48.121063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01598-6040-4f74-be87-069720ce2007 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:48.121372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01598-6040-4f74-be87-069720ce2007 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:48.121619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01598-6040-4f74-be87-069720ce2007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:48.166108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-70d01598-6040-4f74-be87-069720ce2007 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:48.167421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-70d01598-6040-4f74-be87-069720ce2007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:48.202385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048a6c-ae57-4e4f-bd3f-cd8d269db8c8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:48.281715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460e773-c044-4673-b4e2-1109ddc92c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:48.282803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460e773-c044-4673-b4e2-1109ddc92c49 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:48.283284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460e773-c044-4673-b4e2-1109ddc92c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:48.283850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460e773-c044-4673-b4e2-1109ddc92c49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:48.284814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460e773-c044-4673-b4e2-1109ddc92c49 None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=ad0f25125b534983af66d5326f4d626d) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:48.285422 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460e773-c044-4673-b4e2-1109ddc92c49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:48.287294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460e773-c044-4673-b4e2-1109ddc92c49 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:48.298142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 276/542] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:48 2022] GET /identity/v3/role_assignments?user.id=ad0f25125b534983af66d5326f4d626d&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:48.306820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 267/543] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:48.662266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460e773-c044-4673-b4e2-1109ddc92c49 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:48.676049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:48.786613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460e773-c044-4673-b4e2-1109ddc92c49 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:48.828506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa118b-ae62-4469-a92f-1728ebe1b140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:48.829178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa118b-ae62-4469-a92f-1728ebe1b140 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:48.829464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa118b-ae62-4469-a92f-1728ebe1b140 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:48.829736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa118b-ae62-4469-a92f-1728ebe1b140 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:48.840700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa118b-ae62-4469-a92f-1728ebe1b140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-73aa118b-ae62-4469-a92f-1728ebe1b140 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:48.850321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:48.851174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:48.851976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 277/544] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:48.857833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d01598-6040-4f74-be87-069720ce2007 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:48.926959 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:48.999951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d01598-6040-4f74-be87-069720ce2007 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:49.047945 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febed81-b052-46e3-bcc9-22033d8e0fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:49.048920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febed81-b052-46e3-bcc9-22033d8e0fba None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:49.049467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febed81-b052-46e3-bcc9-22033d8e0fba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:49.049950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febed81-b052-46e3-bcc9-22033d8e0fba None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:49.050811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febed81-b052-46e3-bcc9-22033d8e0fba None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:49.051320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febed81-b052-46e3-bcc9-22033d8e0fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:49.052896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febed81-b052-46e3-bcc9-22033d8e0fba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:49.064319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 268/545] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:49.070206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa118b-ae62-4469-a92f-1728ebe1b140 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:49.120881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be2c2-9e7a-41b3-89b3-c80196253774 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:49.121860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be2c2-9e7a-41b3-89b3-c80196253774 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:49.122336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631be2c2-9e7a-41b3-89b3-c80196253774 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:49.124102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 269/546] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:49.132456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213939-9f56-4772-b2aa-041c61b2e44d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:49.133036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213939-9f56-4772-b2aa-041c61b2e44d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:49.133545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213939-9f56-4772-b2aa-041c61b2e44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:49.169434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-65213939-9f56-4772-b2aa-041c61b2e44d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:49.170969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-65213939-9f56-4772-b2aa-041c61b2e44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:49.185389 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:49.213553 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa118b-ae62-4469-a92f-1728ebe1b140 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:49.268540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f1aa-d0a5-416b-b660-d0e59400d72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:49.269199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f1aa-d0a5-416b-b660-d0e59400d72c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:49.269480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f1aa-d0a5-416b-b660-d0e59400d72c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:49.269753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f1aa-d0a5-416b-b660-d0e59400d72c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:49.294899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2f1aa-d0a5-416b-b660-d0e59400d72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:49.296401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2f1aa-d0a5-416b-b660-d0e59400d72c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:49.318262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 270/547] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-55f2f1aa-d0a5-416b-b660-d0e59400d72c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:49.331102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:49.332041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:49.332851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:49.332851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:49.332851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:49.332851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 278/548] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:49.337951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65213939-9f56-4772-b2aa-041c61b2e44d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:49.411323 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:49.489601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65213939-9f56-4772-b2aa-041c61b2e44d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:49.538667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d184b-2f1c-427e-b5b6-33287241755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:49.539292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d184b-2f1c-427e-b5b6-33287241755b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:49.539575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d184b-2f1c-427e-b5b6-33287241755b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:49.540380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d184b-2f1c-427e-b5b6-33287241755b None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:49.541063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d184b-2f1c-427e-b5b6-33287241755b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:49.541370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d184b-2f1c-427e-b5b6-33287241755b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:49.542792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d184b-2f1c-427e-b5b6-33287241755b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:49.561549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 271/549] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:49.566982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f1aa-d0a5-416b-b660-d0e59400d72c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:49.683620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335b02c-38ac-4fb6-88f2-73ddc031e73a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:49.683976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335b02c-38ac-4fb6-88f2-73ddc031e73a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:49.684185 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335b02c-38ac-4fb6-88f2-73ddc031e73a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:49.685678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 272/550] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:19:49.700246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecea5c-14c8-4910-b9b2-5512a87cb381 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:49.700532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecea5c-14c8-4910-b9b2-5512a87cb381 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:49.700807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecea5c-14c8-4910-b9b2-5512a87cb381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:49.724744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f1aa-d0a5-416b-b660-d0e59400d72c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:49.728833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f0ecea5c-14c8-4910-b9b2-5512a87cb381 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:49.730078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f0ecea5c-14c8-4910-b9b2-5512a87cb381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:49.752446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:49.768295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4e4ef-36b8-45f7-98d1-7797d7a522e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:49.769203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4e4ef-36b8-45f7-98d1-7797d7a522e8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:49.769491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4e4ef-36b8-45f7-98d1-7797d7a522e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:49.769767 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4e4ef-36b8-45f7-98d1-7797d7a522e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:49.779694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4e4ef-36b8-45f7-98d1-7797d7a522e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:49.782346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4e4ef-36b8-45f7-98d1-7797d7a522e8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-45b4e4ef-36b8-45f7-98d1-7797d7a522e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:49.796195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:49.797341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:49.798255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 279/551] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:19:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:49.798831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4e4ef-36b8-45f7-98d1-7797d7a522e8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:49.826618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 273/552] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 26 10:19:49.829244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecea5c-14c8-4910-b9b2-5512a87cb381 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:49.887943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:49.976362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4e4ef-36b8-45f7-98d1-7797d7a522e8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:50.020700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecea5c-14c8-4910-b9b2-5512a87cb381 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:50.044665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074092ed-a236-4a33-9a4a-1592990adb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:50.045329 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074092ed-a236-4a33-9a4a-1592990adb2d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.045613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074092ed-a236-4a33-9a4a-1592990adb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.045889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074092ed-a236-4a33-9a4a-1592990adb2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.065841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074092ed-a236-4a33-9a4a-1592990adb2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-074092ed-a236-4a33-9a4a-1592990adb2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:50.071201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:50.072447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:50.073346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 280/553] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:50.078519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074092ed-a236-4a33-9a4a-1592990adb2d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:50.102862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8cee5-585f-445d-aec0-2d60463a1059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:50.103489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8cee5-585f-445d-aec0-2d60463a1059 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.103770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8cee5-585f-445d-aec0-2d60463a1059 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.104046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8cee5-585f-445d-aec0-2d60463a1059 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.108542 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8cee5-585f-445d-aec0-2d60463a1059 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:50.108863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8cee5-585f-445d-aec0-2d60463a1059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:50.110323 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8cee5-585f-445d-aec0-2d60463a1059 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:50.160988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:50.188456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 274/554] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 10:19:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:50.190336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8cee5-585f-445d-aec0-2d60463a1059 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:50.239924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074092ed-a236-4a33-9a4a-1592990adb2d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:50.277377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfc157-ba6c-4a98-a00b-8842d7b8d3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:50.277913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc157-ba6c-4a98-a00b-8842d7b8d3ae None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.278194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc157-ba6c-4a98-a00b-8842d7b8d3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.278470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc157-ba6c-4a98-a00b-8842d7b8d3ae None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.279141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfc157-ba6c-4a98-a00b-8842d7b8d3ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:50.279503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfc157-ba6c-4a98-a00b-8842d7b8d3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:50.281894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfc157-ba6c-4a98-a00b-8842d7b8d3ae None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:50.296903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 281/555] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:50.297814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfc157-ba6c-4a98-a00b-8842d7b8d3ae None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:50.301253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:50.318216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8cee5-585f-445d-aec0-2d60463a1059 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:50.357612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aabe6-40a7-4178-937e-4b646eeaf50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:50.358498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aabe6-40a7-4178-937e-4b646eeaf50f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.358932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aabe6-40a7-4178-937e-4b646eeaf50f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.359408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aabe6-40a7-4178-937e-4b646eeaf50f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.371241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aabe6-40a7-4178-937e-4b646eeaf50f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-862aabe6-40a7-4178-937e-4b646eeaf50f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:50.376505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:50.377583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:50.378923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:50.385250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 275/556] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:50.386438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aabe6-40a7-4178-937e-4b646eeaf50f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:50.417539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfc157-ba6c-4a98-a00b-8842d7b8d3ae None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:50.419668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:50.459824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be270331-d8f8-4069-8715-29dad1a0fe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:50.460442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be270331-d8f8-4069-8715-29dad1a0fe67 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.460741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be270331-d8f8-4069-8715-29dad1a0fe67 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.461025 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be270331-d8f8-4069-8715-29dad1a0fe67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.500139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aabe6-40a7-4178-937e-4b646eeaf50f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:50.538276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937caac1-d089-416d-9bc1-255a40a3a431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:50.538673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be270331-d8f8-4069-8715-29dad1a0fe67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:50.539543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caac1-d089-416d-9bc1-255a40a3a431 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.540058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caac1-d089-416d-9bc1-255a40a3a431 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.540174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be270331-d8f8-4069-8715-29dad1a0fe67 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:50.540650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937caac1-d089-416d-9bc1-255a40a3a431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.551870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937caac1-d089-416d-9bc1-255a40a3a431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:50.553737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937caac1-d089-416d-9bc1-255a40a3a431 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:50.565983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-937caac1-d089-416d-9bc1-255a40a3a431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:50.575671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:50.576751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:50.577867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:50.577867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:50.577867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:50.584465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 276/557] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:50.586422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937caac1-d089-416d-9bc1-255a40a3a431 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:50.672457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 282/558] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:50.673810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be270331-d8f8-4069-8715-29dad1a0fe67 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:50.679204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:50.732283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937caac1-d089-416d-9bc1-255a40a3a431 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:50.778195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870d6d-9729-491b-b0e4-6cd8f7e6f001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:50.779116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870d6d-9729-491b-b0e4-6cd8f7e6f001 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.779392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870d6d-9729-491b-b0e4-6cd8f7e6f001 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.779661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870d6d-9729-491b-b0e4-6cd8f7e6f001 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.780318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea870d6d-9729-491b-b0e4-6cd8f7e6f001 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:50.780619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea870d6d-9729-491b-b0e4-6cd8f7e6f001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:50.782010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea870d6d-9729-491b-b0e4-6cd8f7e6f001 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:50.794432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 277/559] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:50.794432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870d6d-9729-491b-b0e4-6cd8f7e6f001 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:50.799306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be270331-d8f8-4069-8715-29dad1a0fe67 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:50.833192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08dee8-8d8b-4417-8df9-1de1fbfa2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:50.833792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08dee8-8d8b-4417-8df9-1de1fbfa2d55 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.834069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08dee8-8d8b-4417-8df9-1de1fbfa2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.834394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08dee8-8d8b-4417-8df9-1de1fbfa2d55 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.835031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08dee8-8d8b-4417-8df9-1de1fbfa2d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:50.835331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08dee8-8d8b-4417-8df9-1de1fbfa2d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:50.836716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08dee8-8d8b-4417-8df9-1de1fbfa2d55 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:50.847623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 283/560] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:50.848784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351285b-2799-4267-ae55-ef11a2ff9b6a None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.849095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351285b-2799-4267-ae55-ef11a2ff9b6a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.849364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351285b-2799-4267-ae55-ef11a2ff9b6a None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.852989 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 284/561] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:50.852989 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351285b-2799-4267-ae55-ef11a2ff9b6a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:50.855729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:50.894121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870d6d-9729-491b-b0e4-6cd8f7e6f001 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:50.915460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:50.927596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e90917-34a3-4ce2-82b7-8530a41d28b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:50.928218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e90917-34a3-4ce2-82b7-8530a41d28b7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.928508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e90917-34a3-4ce2-82b7-8530a41d28b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.928778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e90917-34a3-4ce2-82b7-8530a41d28b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.939694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e90917-34a3-4ce2-82b7-8530a41d28b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:50.941591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e90917-34a3-4ce2-82b7-8530a41d28b7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:50.954351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351285b-2799-4267-ae55-ef11a2ff9b6a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a5e90917-34a3-4ce2-82b7-8530a41d28b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:50.956024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:50.956972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:50.963425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:50.963425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:50.963425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:50.963425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 278/562] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:50.963425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49950cbb-ba76-4330-9cce-274955084441 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.963425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49950cbb-ba76-4330-9cce-274955084441 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.963425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49950cbb-ba76-4330-9cce-274955084441 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:50.963425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 279/563] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:50.963425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49950cbb-ba76-4330-9cce-274955084441 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:50.991385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9e8d9-6e98-47b3-a048-36d14d04d597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:50.992010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9e8d9-6e98-47b3-a048-36d14d04d597 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:50.992294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9e8d9-6e98-47b3-a048-36d14d04d597 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:50.992566 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9e8d9-6e98-47b3-a048-36d14d04d597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.002327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9e8d9-6e98-47b3-a048-36d14d04d597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:51.003754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9e8d9-6e98-47b3-a048-36d14d04d597 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-bbc9e8d9-6e98-47b3-a048-36d14d04d597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:51.018508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:51.019531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:51.020435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:51.020435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:51.020435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:51.020435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 285/564] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:51.020694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96bcf-4d38-46af-952a-b506ff33635b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.020983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96bcf-4d38-46af-952a-b506ff33635b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.021262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96bcf-4d38-46af-952a-b506ff33635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.039852 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e4e96bcf-4d38-46af-952a-b506ff33635b None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:51.041067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e4e96bcf-4d38-46af-952a-b506ff33635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:51.066400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49950cbb-ba76-4330-9cce-274955084441 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:51.079885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:51.101457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e51b5-3f0d-47fd-9b38-5087ee14be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:51.102075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e51b5-3f0d-47fd-9b38-5087ee14be08 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.102886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e51b5-3f0d-47fd-9b38-5087ee14be08 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.103155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e51b5-3f0d-47fd-9b38-5087ee14be08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.110201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 286/565] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:51.110447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e51b5-3f0d-47fd-9b38-5087ee14be08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:51.111013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96bcf-4d38-46af-952a-b506ff33635b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:51.111893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e51b5-3f0d-47fd-9b38-5087ee14be08 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ef6e51b5-3f0d-47fd-9b38-5087ee14be08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:51.129045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:51.129963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:51.130887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:51.130887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:51.130887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:51.130887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:51.130887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:51.130887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:51.130887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:51.130887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:51.130887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:19:51.130887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:51.135319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 280/566] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 10:19:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:51.136524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753890-8e84-48fa-b57b-1985bd40550c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.136811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753890-8e84-48fa-b57b-1985bd40550c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.137116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753890-8e84-48fa-b57b-1985bd40550c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.156375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a2753890-8e84-48fa-b57b-1985bd40550c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:51.157685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a2753890-8e84-48fa-b57b-1985bd40550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:51.165415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:51.227930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96bcf-4d38-46af-952a-b506ff33635b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:51.240990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 281/567] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:51.240990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2753890-8e84-48fa-b57b-1985bd40550c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:51.270312 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25b13b-e767-4219-a80e-896601e6bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:51.271325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b13b-e767-4219-a80e-896601e6bd35 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.271610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b13b-e767-4219-a80e-896601e6bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.271884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b13b-e767-4219-a80e-896601e6bd35 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.272528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25b13b-e767-4219-a80e-896601e6bd35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:51.272831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25b13b-e767-4219-a80e-896601e6bd35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:51.274284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25b13b-e767-4219-a80e-896601e6bd35 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:51.288537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 287/568] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:51.289511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25b13b-e767-4219-a80e-896601e6bd35 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:51.370576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2753890-8e84-48fa-b57b-1985bd40550c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:51.373628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:51.408140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6d887-858f-41ea-9c2c-e2689b258f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:51.408746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6d887-858f-41ea-9c2c-e2689b258f6c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.409066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6d887-858f-41ea-9c2c-e2689b258f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.409344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6d887-858f-41ea-9c2c-e2689b258f6c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.409986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6d887-858f-41ea-9c2c-e2689b258f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:51.410290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6d887-858f-41ea-9c2c-e2689b258f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:51.411654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6d887-858f-41ea-9c2c-e2689b258f6c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:51.420211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25b13b-e767-4219-a80e-896601e6bd35 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:51.424582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 282/569] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:51.428988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6d887-858f-41ea-9c2c-e2689b258f6c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:51.429131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:51.457283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464b6ac-2ab7-41e2-8ffc-9929adbb8dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:51.457892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464b6ac-2ab7-41e2-8ffc-9929adbb8dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.458184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464b6ac-2ab7-41e2-8ffc-9929adbb8dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.458465 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464b6ac-2ab7-41e2-8ffc-9929adbb8dd5 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.459188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464b6ac-2ab7-41e2-8ffc-9929adbb8dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:51.459500 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464b6ac-2ab7-41e2-8ffc-9929adbb8dd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:51.460906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464b6ac-2ab7-41e2-8ffc-9929adbb8dd5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:51.479511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 288/570] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:51.480398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464b6ac-2ab7-41e2-8ffc-9929adbb8dd5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:51.535220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6d887-858f-41ea-9c2c-e2689b258f6c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:51.567675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56eba8e-eab2-47ee-b3c4-b4103abb8d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:51.568294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56eba8e-eab2-47ee-b3c4-b4103abb8d93 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.568578 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56eba8e-eab2-47ee-b3c4-b4103abb8d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.568854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56eba8e-eab2-47ee-b3c4-b4103abb8d93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.575821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56eba8e-eab2-47ee-b3c4-b4103abb8d93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:51.577297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56eba8e-eab2-47ee-b3c4-b4103abb8d93 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:51.583134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464b6ac-2ab7-41e2-8ffc-9929adbb8dd5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b56eba8e-eab2-47ee-b3c4-b4103abb8d93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:51.589287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:51.590206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:51.591076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:51.591076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:51.591076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:51.591076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:51.591076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:51.591076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:51.591076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:51.591076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:51.591076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 283/571] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:51.592524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56eba8e-eab2-47ee-b3c4-b4103abb8d93 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:51.619971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:51.621317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624c0ec-fb20-4ed8-a7a8-e90c03677b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:51.621949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624c0ec-fb20-4ed8-a7a8-e90c03677b07 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.622245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624c0ec-fb20-4ed8-a7a8-e90c03677b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.622498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624c0ec-fb20-4ed8-a7a8-e90c03677b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.632832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624c0ec-fb20-4ed8-a7a8-e90c03677b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-e624c0ec-fb20-4ed8-a7a8-e90c03677b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:51.637689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:51.638723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 289/572] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:51.639603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624c0ec-fb20-4ed8-a7a8-e90c03677b07 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:51.664279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:51.694013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56eba8e-eab2-47ee-b3c4-b4103abb8d93 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:51.726844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c6319-524b-465e-8407-a5f40efa9b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:51.728031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c6319-524b-465e-8407-a5f40efa9b47 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.728309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c6319-524b-465e-8407-a5f40efa9b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.728577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c6319-524b-465e-8407-a5f40efa9b47 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.735990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c6319-524b-465e-8407-a5f40efa9b47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:51.737456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c6319-524b-465e-8407-a5f40efa9b47 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:51.739635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624c0ec-fb20-4ed8-a7a8-e90c03677b07 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fc1c6319-524b-465e-8407-a5f40efa9b47 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:51.748395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:51.749541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 284/573] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:51.750528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c6319-524b-465e-8407-a5f40efa9b47 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:51.775593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41970e5e-4bc8-4445-b050-752f6add7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:51.776467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970e5e-4bc8-4445-b050-752f6add7201 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.776741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970e5e-4bc8-4445-b050-752f6add7201 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.777071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970e5e-4bc8-4445-b050-752f6add7201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.786894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41970e5e-4bc8-4445-b050-752f6add7201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:51.788320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41970e5e-4bc8-4445-b050-752f6add7201 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-41970e5e-4bc8-4445-b050-752f6add7201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:51.802738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:51.803797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:51.804648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:51.804648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:51.804648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:51.804648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 290/574] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:51.805162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41970e5e-4bc8-4445-b050-752f6add7201 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:51.831653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:51.846917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c6319-524b-465e-8407-a5f40efa9b47 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:51.880040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00424df-414d-4a92-842e-8d3638cda6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:51.880587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00424df-414d-4a92-842e-8d3638cda6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.880861 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00424df-414d-4a92-842e-8d3638cda6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.881157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00424df-414d-4a92-842e-8d3638cda6e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.883311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:51.891203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00424df-414d-4a92-842e-8d3638cda6e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f00424df-414d-4a92-842e-8d3638cda6e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:51.897007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:51.897920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:51.898774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 285/575] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:51.900171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00424df-414d-4a92-842e-8d3638cda6e5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:51.908316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41970e5e-4bc8-4445-b050-752f6add7201 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:51.940631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2024e-ed5b-430b-be44-c40e23387da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:51.941282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2024e-ed5b-430b-be44-c40e23387da7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:51.941556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2024e-ed5b-430b-be44-c40e23387da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:51.941827 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2024e-ed5b-430b-be44-c40e23387da7 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:51.942524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2024e-ed5b-430b-be44-c40e23387da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:51.942827 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2024e-ed5b-430b-be44-c40e23387da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:51.944216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2024e-ed5b-430b-be44-c40e23387da7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:51.956487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 291/576] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:51.957283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2024e-ed5b-430b-be44-c40e23387da7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.009795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00424df-414d-4a92-842e-8d3638cda6e5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.042578 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9123bc9-8c52-448e-88b5-e8eff98ab0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.043189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9123bc9-8c52-448e-88b5-e8eff98ab0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.043463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9123bc9-8c52-448e-88b5-e8eff98ab0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.043733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9123bc9-8c52-448e-88b5-e8eff98ab0f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.044388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9123bc9-8c52-448e-88b5-e8eff98ab0f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:52.044689 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9123bc9-8c52-448e-88b5-e8eff98ab0f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.046090 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9123bc9-8c52-448e-88b5-e8eff98ab0f6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.053980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 286/577] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:52.059334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9123bc9-8c52-448e-88b5-e8eff98ab0f6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.068251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:52.073708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2024e-ed5b-430b-be44-c40e23387da7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.113855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90feb840-c9d9-4679-8e57-a0051609234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.114466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feb840-c9d9-4679-8e57-a0051609234b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.114794 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feb840-c9d9-4679-8e57-a0051609234b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.115072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feb840-c9d9-4679-8e57-a0051609234b None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.115796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90feb840-c9d9-4679-8e57-a0051609234b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:52.116125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90feb840-c9d9-4679-8e57-a0051609234b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.118552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90feb840-c9d9-4679-8e57-a0051609234b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.121948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:52.138407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 292/578] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 10:19:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:52.138974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90feb840-c9d9-4679-8e57-a0051609234b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.168675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9123bc9-8c52-448e-88b5-e8eff98ab0f6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.213078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420000c3-48c1-4b50-ad44-6b703a284f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.213691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420000c3-48c1-4b50-ad44-6b703a284f48 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.213970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420000c3-48c1-4b50-ad44-6b703a284f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.214240 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420000c3-48c1-4b50-ad44-6b703a284f48 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.215285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420000c3-48c1-4b50-ad44-6b703a284f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:52.215599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420000c3-48c1-4b50-ad44-6b703a284f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.217550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420000c3-48c1-4b50-ad44-6b703a284f48 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.235287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 287/579] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:52.235287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420000c3-48c1-4b50-ad44-6b703a284f48 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.247915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90feb840-c9d9-4679-8e57-a0051609234b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.282624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ef252-141a-47af-9013-5d37f4c6b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.283227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ef252-141a-47af-9013-5d37f4c6b47d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.283591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ef252-141a-47af-9013-5d37f4c6b47d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.283867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ef252-141a-47af-9013-5d37f4c6b47d None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.284524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ef252-141a-47af-9013-5d37f4c6b47d None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:52.284819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ef252-141a-47af-9013-5d37f4c6b47d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.286196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ef252-141a-47af-9013-5d37f4c6b47d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.294344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 293/580] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:52.295337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ef252-141a-47af-9013-5d37f4c6b47d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.299884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:52.335235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420000c3-48c1-4b50-ad44-6b703a284f48 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.348711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:52.370537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391688c9-caa1-4a99-a615-d634e8af4475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.371161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391688c9-caa1-4a99-a615-d634e8af4475 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.371438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391688c9-caa1-4a99-a615-d634e8af4475 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.371706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391688c9-caa1-4a99-a615-d634e8af4475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.372420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391688c9-caa1-4a99-a615-d634e8af4475 None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=e5b380b92dc5438c92380c3fe2406590) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:52.372724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391688c9-caa1-4a99-a615-d634e8af4475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.374176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391688c9-caa1-4a99-a615-d634e8af4475 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.379589 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 288/581] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/role_assignments?user.id=e5b380b92dc5438c92380c3fe2406590&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:52.380176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391688c9-caa1-4a99-a615-d634e8af4475 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.411770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ef252-141a-47af-9013-5d37f4c6b47d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.448866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bd6f7-7849-41c6-b284-3e7314cb6e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.449532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bd6f7-7849-41c6-b284-3e7314cb6e03 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.449986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bd6f7-7849-41c6-b284-3e7314cb6e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.450259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bd6f7-7849-41c6-b284-3e7314cb6e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.462854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bd6f7-7849-41c6-b284-3e7314cb6e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.464773 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bd6f7-7849-41c6-b284-3e7314cb6e03 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ae1bd6f7-7849-41c6-b284-3e7314cb6e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:52.481993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:52.483028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:52.483894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:52.483894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:52.483894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:52.483894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 294/582] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:52.484109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bd6f7-7849-41c6-b284-3e7314cb6e03 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.497145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391688c9-caa1-4a99-a615-d634e8af4475 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.529132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:52.535555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeba257-da3b-46e8-82bc-0da4c705255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.536201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeba257-da3b-46e8-82bc-0da4c705255d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.536493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeba257-da3b-46e8-82bc-0da4c705255d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.536743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeba257-da3b-46e8-82bc-0da4c705255d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.548519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeba257-da3b-46e8-82bc-0da4c705255d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.550010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeba257-da3b-46e8-82bc-0da4c705255d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2eeba257-da3b-46e8-82bc-0da4c705255d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:52.566112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:52.567064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:52.567922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:52.567922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:52.567922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:52.569344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 289/583] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:52.570258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeba257-da3b-46e8-82bc-0da4c705255d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.599376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bd6f7-7849-41c6-b284-3e7314cb6e03 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.609875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:52.638749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b19e9-5f6c-41b3-b570-2cc912b10e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.639406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b19e9-5f6c-41b3-b570-2cc912b10e8b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.639853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b19e9-5f6c-41b3-b570-2cc912b10e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.640130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b19e9-5f6c-41b3-b570-2cc912b10e8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.647270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b19e9-5f6c-41b3-b570-2cc912b10e8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.648883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b19e9-5f6c-41b3-b570-2cc912b10e8b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-427b19e9-5f6c-41b3-b570-2cc912b10e8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:52.661660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:52.662776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:52.663864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:52.663864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:52.663864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:52.663864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:52.663864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:52.663864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:52.663864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:52.663864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:52.669070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 295/584] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:52.669896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b19e9-5f6c-41b3-b570-2cc912b10e8b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.683546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeba257-da3b-46e8-82bc-0da4c705255d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.720500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a95bf7-0f06-4df7-9fcc-d6f42127b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.721228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a95bf7-0f06-4df7-9fcc-d6f42127b25f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.721510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a95bf7-0f06-4df7-9fcc-d6f42127b25f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.721780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a95bf7-0f06-4df7-9fcc-d6f42127b25f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.733335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a95bf7-0f06-4df7-9fcc-d6f42127b25f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.735096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a95bf7-0f06-4df7-9fcc-d6f42127b25f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-12a95bf7-0f06-4df7-9fcc-d6f42127b25f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:52.750290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:52.751216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:52.756537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:52.756537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:52.756537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:52.756537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 290/585] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:52.756537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a95bf7-0f06-4df7-9fcc-d6f42127b25f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.779953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b19e9-5f6c-41b3-b570-2cc912b10e8b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.789413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:52.815625 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eff9bc-f7a6-466c-bc1f-235f707c7a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.816223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eff9bc-f7a6-466c-bc1f-235f707c7a7d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.816537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eff9bc-f7a6-466c-bc1f-235f707c7a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.816918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eff9bc-f7a6-466c-bc1f-235f707c7a7d None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.817918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eff9bc-f7a6-466c-bc1f-235f707c7a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:52.818380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eff9bc-f7a6-466c-bc1f-235f707c7a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.819736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eff9bc-f7a6-466c-bc1f-235f707c7a7d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.831230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 296/586] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:52.832035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eff9bc-f7a6-466c-bc1f-235f707c7a7d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.862203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a95bf7-0f06-4df7-9fcc-d6f42127b25f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.862684 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:52.898357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac40c-edfc-49f5-aeb4-5bb8020265c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.899718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac40c-edfc-49f5-aeb4-5bb8020265c7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.900140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac40c-edfc-49f5-aeb4-5bb8020265c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.900576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac40c-edfc-49f5-aeb4-5bb8020265c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.901815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eac40c-edfc-49f5-aeb4-5bb8020265c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:52.902258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eac40c-edfc-49f5-aeb4-5bb8020265c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.903870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eac40c-edfc-49f5-aeb4-5bb8020265c7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.916042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 291/587] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:52.917279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac40c-edfc-49f5-aeb4-5bb8020265c7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:52.940550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eff9bc-f7a6-466c-bc1f-235f707c7a7d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:52.974944 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9f06-b876-43a5-ba8b-9a2e65ced45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:52.975539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9f06-b876-43a5-ba8b-9a2e65ced45f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:52.975815 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9f06-b876-43a5-ba8b-9a2e65ced45f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:52.976142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9f06-b876-43a5-ba8b-9a2e65ced45f None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:52.976824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e9f06-b876-43a5-ba8b-9a2e65ced45f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:52.977156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e9f06-b876-43a5-ba8b-9a2e65ced45f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:52.978598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e9f06-b876-43a5-ba8b-9a2e65ced45f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:52.993325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 297/588] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:52.993325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9f06-b876-43a5-ba8b-9a2e65ced45f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.018541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:53.024782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac40c-edfc-49f5-aeb4-5bb8020265c7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.060788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecffb1-93b0-46c9-aecf-1ed69ff91e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.061456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecffb1-93b0-46c9-aecf-1ed69ff91e11 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.061734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecffb1-93b0-46c9-aecf-1ed69ff91e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.062005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecffb1-93b0-46c9-aecf-1ed69ff91e11 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:53.062693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecffb1-93b0-46c9-aecf-1ed69ff91e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:53.062994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecffb1-93b0-46c9-aecf-1ed69ff91e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:53.064347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecffb1-93b0-46c9-aecf-1ed69ff91e11 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:53.076325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 292/589] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:53.077131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecffb1-93b0-46c9-aecf-1ed69ff91e11 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.095406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:53.110222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9f06-b876-43a5-ba8b-9a2e65ced45f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.146230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae424-d06f-481f-a779-74c6bbb35b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.147104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae424-d06f-481f-a779-74c6bbb35b8b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.148241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae424-d06f-481f-a779-74c6bbb35b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.148523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae424-d06f-481f-a779-74c6bbb35b8b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:53.157849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae424-d06f-481f-a779-74c6bbb35b8b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:53.159254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae424-d06f-481f-a779-74c6bbb35b8b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c4bae424-d06f-481f-a779-74c6bbb35b8b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:53.171073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:53.172255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 298/590] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:53.173242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae424-d06f-481f-a779-74c6bbb35b8b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.186581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecffb1-93b0-46c9-aecf-1ed69ff91e11 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.221590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbd72-717e-4ee5-8c24-a65a51e9d804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.222221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbd72-717e-4ee5-8c24-a65a51e9d804 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.222501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbd72-717e-4ee5-8c24-a65a51e9d804 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.222774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbd72-717e-4ee5-8c24-a65a51e9d804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:53.230918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fbd72-717e-4ee5-8c24-a65a51e9d804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:53.232358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fbd72-717e-4ee5-8c24-a65a51e9d804 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-651fbd72-717e-4ee5-8c24-a65a51e9d804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:53.244072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:53.245045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:53.245966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:53.245966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:53.245966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:53.245966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:53.245966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:53.245966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:53.245966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:53.245966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:53.245966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 293/591] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:53.246449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbd72-717e-4ee5-8c24-a65a51e9d804 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.269002 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:53.286768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae424-d06f-481f-a779-74c6bbb35b8b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.323305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2687ef5-20fd-4404-b3f5-a79a185490d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.324204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2687ef5-20fd-4404-b3f5-a79a185490d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.324482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2687ef5-20fd-4404-b3f5-a79a185490d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.324755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2687ef5-20fd-4404-b3f5-a79a185490d4 None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/e58300ef26a547028e837ba2da615991/roles/c2bcddceaa5642beb73d7d1012bd46ec` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:53.339197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2687ef5-20fd-4404-b3f5-a79a185490d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=e58300ef26a547028e837ba2da615991, role_id=c2bcddceaa5642beb73d7d1012bd46ec)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:53.340646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2687ef5-20fd-4404-b3f5-a79a185490d4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:53.350363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:53.360000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 299/592] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:19:53 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/e58300ef26a547028e837ba2da615991/roles/c2bcddceaa5642beb73d7d1012bd46ec => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:53.361140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2687ef5-20fd-4404-b3f5-a79a185490d4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.374894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbd72-717e-4ee5-8c24-a65a51e9d804 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.416826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a3e9c-f52f-406e-a91f-d5aabf3e5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.417711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a3e9c-f52f-406e-a91f-d5aabf3e5f91 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.418134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a3e9c-f52f-406e-a91f-d5aabf3e5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.418539 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a3e9c-f52f-406e-a91f-d5aabf3e5f91 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:53.429025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a3e9c-f52f-406e-a91f-d5aabf3e5f91 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:53.430987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a3e9c-f52f-406e-a91f-d5aabf3e5f91 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-444a3e9c-f52f-406e-a91f-d5aabf3e5f91 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:53.444832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:53.446430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:53.447418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:53.447418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:53.447418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:53.447418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:53.447418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:53.447418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:53.447418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:53.447418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:53.447418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 10:19:53.447418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:53.452398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 294/593] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:53.453434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a3e9c-f52f-406e-a91f-d5aabf3e5f91 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.486283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2687ef5-20fd-4404-b3f5-a79a185490d4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.527573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1314389-a215-42e8-950f-023c57f184a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.528994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314389-a215-42e8-950f-023c57f184a0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.529724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314389-a215-42e8-950f-023c57f184a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.530198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314389-a215-42e8-950f-023c57f184a0 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:53.531151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1314389-a215-42e8-950f-023c57f184a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:53.531654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1314389-a215-42e8-950f-023c57f184a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:53.533308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1314389-a215-42e8-950f-023c57f184a0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:53.543294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:53.554205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 300/594] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 10:19:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:53.555084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1314389-a215-42e8-950f-023c57f184a0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.570532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a3e9c-f52f-406e-a91f-d5aabf3e5f91 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.607883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe71f9-15f6-4106-a67e-727f6491743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.608493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe71f9-15f6-4106-a67e-727f6491743f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.608776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe71f9-15f6-4106-a67e-727f6491743f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.609082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe71f9-15f6-4106-a67e-727f6491743f None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:53.609782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe71f9-15f6-4106-a67e-727f6491743f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:53.610091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe71f9-15f6-4106-a67e-727f6491743f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:53.611528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe71f9-15f6-4106-a67e-727f6491743f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:53.619257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:53.629068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 295/595] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:53.629962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe71f9-15f6-4106-a67e-727f6491743f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.674346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1314389-a215-42e8-950f-023c57f184a0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.713910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c52d48-adc2-4cdf-b6b4-937c30824212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.714430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52d48-adc2-4cdf-b6b4-937c30824212 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.714706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52d48-adc2-4cdf-b6b4-937c30824212 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.714974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52d48-adc2-4cdf-b6b4-937c30824212 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:53.716165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c52d48-adc2-4cdf-b6b4-937c30824212 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:53.716493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c52d48-adc2-4cdf-b6b4-937c30824212 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:53.718386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c52d48-adc2-4cdf-b6b4-937c30824212 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:53.741094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 301/596] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Sep 26 10:19:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:53.741922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c52d48-adc2-4cdf-b6b4-937c30824212 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.747820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe71f9-15f6-4106-a67e-727f6491743f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.795745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f532885-1ac7-4e8e-9d68-6d6730da8934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.797011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f532885-1ac7-4e8e-9d68-6d6730da8934 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.797888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f532885-1ac7-4e8e-9d68-6d6730da8934 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.798388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f532885-1ac7-4e8e-9d68-6d6730da8934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:53.801066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:53.814280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f532885-1ac7-4e8e-9d68-6d6730da8934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:53.816236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f532885-1ac7-4e8e-9d68-6d6730da8934 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1f532885-1ac7-4e8e-9d68-6d6730da8934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:53.833740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:53.834771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:53.835651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:53.835651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:53.835651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:53.838348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 296/597] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:53.839295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f532885-1ac7-4e8e-9d68-6d6730da8934 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.867218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c52d48-adc2-4cdf-b6b4-937c30824212 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.886662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:53.915326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef76e-12ae-4a92-b6a7-b0f0d46e92be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.916042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef76e-12ae-4a92-b6a7-b0f0d46e92be None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.916333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef76e-12ae-4a92-b6a7-b0f0d46e92be None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.916610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef76e-12ae-4a92-b6a7-b0f0d46e92be None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/dcfef506919f4914a7883bd99ea07615/roles/c2bcddceaa5642beb73d7d1012bd46ec` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:53.938702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebef76e-12ae-4a92-b6a7-b0f0d46e92be None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=dcfef506919f4914a7883bd99ea07615, role_id=c2bcddceaa5642beb73d7d1012bd46ec)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:53.940579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebef76e-12ae-4a92-b6a7-b0f0d46e92be None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:53.945061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f532885-1ac7-4e8e-9d68-6d6730da8934 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:53.956917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 302/598] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:19:53 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/dcfef506919f4914a7883bd99ea07615/roles/c2bcddceaa5642beb73d7d1012bd46ec => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:53.957790 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef76e-12ae-4a92-b6a7-b0f0d46e92be None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:53.997779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cae90-ba0d-488f-a3c7-9a502870e933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:53.998379 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cae90-ba0d-488f-a3c7-9a502870e933 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:53.998660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cae90-ba0d-488f-a3c7-9a502870e933 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:53.998934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cae90-ba0d-488f-a3c7-9a502870e933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:54.028293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cae90-ba0d-488f-a3c7-9a502870e933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:54.031094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cae90-ba0d-488f-a3c7-9a502870e933 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e74cae90-ba0d-488f-a3c7-9a502870e933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:54.062305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:54.063291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:54.064149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:54.064149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:54.064149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:54.064149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 297/599] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:54.072289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cae90-ba0d-488f-a3c7-9a502870e933 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:54.122418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef76e-12ae-4a92-b6a7-b0f0d46e92be None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:54.153978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:54.164527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf969354-2f90-4883-8cf9-5dda4aea595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:54.166596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969354-2f90-4883-8cf9-5dda4aea595d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:54.167076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969354-2f90-4883-8cf9-5dda4aea595d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:54.167619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969354-2f90-4883-8cf9-5dda4aea595d None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:54.168518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf969354-2f90-4883-8cf9-5dda4aea595d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:54.169051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf969354-2f90-4883-8cf9-5dda4aea595d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:54.170556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf969354-2f90-4883-8cf9-5dda4aea595d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:54.183017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 303/600] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:54.190392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf969354-2f90-4883-8cf9-5dda4aea595d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:54.227505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:54.242027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cae90-ba0d-488f-a3c7-9a502870e933 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:54.280231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57f07-3cf3-4ef5-b7c1-76e2e969f3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:54.281128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57f07-3cf3-4ef5-b7c1-76e2e969f3ff None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:54.281660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57f07-3cf3-4ef5-b7c1-76e2e969f3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:54.282151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57f07-3cf3-4ef5-b7c1-76e2e969f3ff None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:54.282997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b57f07-3cf3-4ef5-b7c1-76e2e969f3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:54.283505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b57f07-3cf3-4ef5-b7c1-76e2e969f3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:54.285286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b57f07-3cf3-4ef5-b7c1-76e2e969f3ff None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:54.300140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 298/601] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:54.305184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57f07-3cf3-4ef5-b7c1-76e2e969f3ff None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:54.328984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf969354-2f90-4883-8cf9-5dda4aea595d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:54.367718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f6e3-ac6d-4f00-bc80-3fd915ceddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:54.367718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f6e3-ac6d-4f00-bc80-3fd915ceddea None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:54.368623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f6e3-ac6d-4f00-bc80-3fd915ceddea None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:54.368789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f6e3-ac6d-4f00-bc80-3fd915ceddea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:54.385198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738f6e3-ac6d-4f00-bc80-3fd915ceddea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:54.386629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738f6e3-ac6d-4f00-bc80-3fd915ceddea None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-0738f6e3-ac6d-4f00-bc80-3fd915ceddea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:54.413527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:54.414525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:54.415527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:54.415527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:54.415527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:54.415527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:54.415527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:54.415527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:54.415527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:54.415527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:54.415978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 304/602] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:54.421454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f6e3-ac6d-4f00-bc80-3fd915ceddea None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:54.470918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:54.474977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57f07-3cf3-4ef5-b7c1-76e2e969f3ff None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:54.517350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d67fd2-9259-47b7-9614-640e1ee9badc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:54.517974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d67fd2-9259-47b7-9614-640e1ee9badc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:54.518257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d67fd2-9259-47b7-9614-640e1ee9badc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:54.518522 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d67fd2-9259-47b7-9614-640e1ee9badc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:54.531099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d67fd2-9259-47b7-9614-640e1ee9badc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:54.532474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d67fd2-9259-47b7-9614-640e1ee9badc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-01d67fd2-9259-47b7-9614-640e1ee9badc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:54.551062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:54.552037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:54.552902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:54.552902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:54.552902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:54.552902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:54.552902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:54.552902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:54.552902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:54.552902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:54.556106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 299/603] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:54.562108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d67fd2-9259-47b7-9614-640e1ee9badc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:54.593509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:54.612107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f6e3-ac6d-4f00-bc80-3fd915ceddea None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:54.650029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7507c58-59a4-449b-a0ae-2a8296badbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:54.651001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7507c58-59a4-449b-a0ae-2a8296badbeb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:54.651285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7507c58-59a4-449b-a0ae-2a8296badbeb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:54.651561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7507c58-59a4-449b-a0ae-2a8296badbeb None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:54.652251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7507c58-59a4-449b-a0ae-2a8296badbeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:54.652560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7507c58-59a4-449b-a0ae-2a8296badbeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:54.654014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7507c58-59a4-449b-a0ae-2a8296badbeb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:54.666452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 305/604] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:54.672157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7507c58-59a4-449b-a0ae-2a8296badbeb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:54.709550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d67fd2-9259-47b7-9614-640e1ee9badc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:54.758088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72034a58-6304-4d99-bd18-b9527e41e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:54.759267 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72034a58-6304-4d99-bd18-b9527e41e1ab None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:54.759547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72034a58-6304-4d99-bd18-b9527e41e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:54.759812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72034a58-6304-4d99-bd18-b9527e41e1ab None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:54.760491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72034a58-6304-4d99-bd18-b9527e41e1ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:54.760790 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72034a58-6304-4d99-bd18-b9527e41e1ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:54.762226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72034a58-6304-4d99-bd18-b9527e41e1ab None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:54.780816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 300/605] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:54.780816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201ccc3-ea83-4321-9ef6-bf46d6267450 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:54.780816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201ccc3-ea83-4321-9ef6-bf46d6267450 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:54.780816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201ccc3-ea83-4321-9ef6-bf46d6267450 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:54.780816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 301/606] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:54.784634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201ccc3-ea83-4321-9ef6-bf46d6267450 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:54.802097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7507c58-59a4-449b-a0ae-2a8296badbeb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:54.809298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:54.838352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b016b-ed6d-4b1c-819a-6e99752b850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:54.839186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b016b-ed6d-4b1c-819a-6e99752b850d None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:54.839565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b016b-ed6d-4b1c-819a-6e99752b850d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:54.839958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b016b-ed6d-4b1c-819a-6e99752b850d None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/561dd954e4184662b33ca3356aa08d15/roles/c2bcddceaa5642beb73d7d1012bd46ec` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:54.855239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b016b-ed6d-4b1c-819a-6e99752b850d None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=561dd954e4184662b33ca3356aa08d15, role_id=c2bcddceaa5642beb73d7d1012bd46ec)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:54.857443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b016b-ed6d-4b1c-819a-6e99752b850d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:54.859919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:54.881038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 306/607] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:19:54 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/561dd954e4184662b33ca3356aa08d15/roles/c2bcddceaa5642beb73d7d1012bd46ec => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:19:54.881038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae9528-4438-4032-982d-25a637f71410 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:54.881038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae9528-4438-4032-982d-25a637f71410 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:54.881038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae9528-4438-4032-982d-25a637f71410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:54.899249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3cae9528-4438-4032-982d-25a637f71410 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:54.900627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3cae9528-4438-4032-982d-25a637f71410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:54.937697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201ccc3-ea83-4321-9ef6-bf46d6267450 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:54.980026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 307/608] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:55.009258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c3de5-ddc8-45b5-9b09-4091265585b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:55.010224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c3de5-ddc8-45b5-9b09-4091265585b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:55.010666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c3de5-ddc8-45b5-9b09-4091265585b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:55.011116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c3de5-ddc8-45b5-9b09-4091265585b9 None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/ad0f25125b534983af66d5326f4d626d/roles/c2bcddceaa5642beb73d7d1012bd46ec` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:55.042658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c3de5-ddc8-45b5-9b09-4091265585b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=ad0f25125b534983af66d5326f4d626d, role_id=c2bcddceaa5642beb73d7d1012bd46ec)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:55.044422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c3de5-ddc8-45b5-9b09-4091265585b9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:55.073444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 302/609] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:19:54 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/ad0f25125b534983af66d5326f4d626d/roles/c2bcddceaa5642beb73d7d1012bd46ec => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:19:55.362788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae9528-4438-4032-982d-25a637f71410 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:55.482087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae9528-4438-4032-982d-25a637f71410 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:55.510243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:55.523238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ae8c4-fedf-482e-b54b-1aec20d04069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:55.524118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae8c4-fedf-482e-b54b-1aec20d04069 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:55.524550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae8c4-fedf-482e-b54b-1aec20d04069 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:55.525010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae8c4-fedf-482e-b54b-1aec20d04069 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:55.545799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ae8c4-fedf-482e-b54b-1aec20d04069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ec5ae8c4-fedf-482e-b54b-1aec20d04069 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:55.550988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:55.552135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:55.553210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:55.555197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 308/610] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:55.561725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c3de5-ddc8-45b5-9b09-4091265585b9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:55.674352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:55.718739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c3de5-ddc8-45b5-9b09-4091265585b9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:55.766442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d9957-244b-47e2-acdb-d437b836d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:55.767065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d9957-244b-47e2-acdb-d437b836d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:55.767349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d9957-244b-47e2-acdb-d437b836d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:55.767623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d9957-244b-47e2-acdb-d437b836d7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:55.768303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d9957-244b-47e2-acdb-d437b836d7c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:55.768611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d9957-244b-47e2-acdb-d437b836d7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:55.770058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d9957-244b-47e2-acdb-d437b836d7c6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:55.780201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 303/611] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:55.785437 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ae8c4-fedf-482e-b54b-1aec20d04069 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:55.872191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11c039-cc21-4736-b84a-f3ee3cac74c7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:55.872524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11c039-cc21-4736-b84a-f3ee3cac74c7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:55.872747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11c039-cc21-4736-b84a-f3ee3cac74c7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:55.874472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 304/612] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:19:55.880528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b19bb-9ce8-468d-9c76-c844af0bceaf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:55.881136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b19bb-9ce8-468d-9c76-c844af0bceaf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:55.881623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b19bb-9ce8-468d-9c76-c844af0bceaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:55.906312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ba4b19bb-9ce8-468d-9c76-c844af0bceaf None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:55.907858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ba4b19bb-9ce8-468d-9c76-c844af0bceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:55.940761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ae8c4-fedf-482e-b54b-1aec20d04069 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:56.004324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa2c54-17ac-41dd-80ae-0f414fddd8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:56.004971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa2c54-17ac-41dd-80ae-0f414fddd8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:56.005267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa2c54-17ac-41dd-80ae-0f414fddd8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:56.005544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa2c54-17ac-41dd-80ae-0f414fddd8a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:56.009438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 305/613] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:19:56.018176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa2c54-17ac-41dd-80ae-0f414fddd8a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:56.019708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa2c54-17ac-41dd-80ae-0f414fddd8a1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a8aa2c54-17ac-41dd-80ae-0f414fddd8a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:56.034895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:56.036094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:56.037239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:56.037239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:56.037239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:56.040981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 309/614] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:56.043411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b19bb-9ce8-468d-9c76-c844af0bceaf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:56.103094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:56.147265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b19bb-9ce8-468d-9c76-c844af0bceaf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:56.189663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3bedc-b5d9-454b-bc73-d2e8986385ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:56.190276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3bedc-b5d9-454b-bc73-d2e8986385ba None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:56.190559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3bedc-b5d9-454b-bc73-d2e8986385ba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:56.190891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3bedc-b5d9-454b-bc73-d2e8986385ba None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:56.191491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3bedc-b5d9-454b-bc73-d2e8986385ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:56.191794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3bedc-b5d9-454b-bc73-d2e8986385ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:56.193204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3bedc-b5d9-454b-bc73-d2e8986385ba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:56.205165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 306/615] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:56.210666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa2c54-17ac-41dd-80ae-0f414fddd8a1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:56.251181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:56.339082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa2c54-17ac-41dd-80ae-0f414fddd8a1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:56.397713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856f08-e328-4384-8924-b35a78e64e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:56.399191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856f08-e328-4384-8924-b35a78e64e5d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:56.399731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856f08-e328-4384-8924-b35a78e64e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:56.400220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856f08-e328-4384-8924-b35a78e64e5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:56.411828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856f08-e328-4384-8924-b35a78e64e5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:56.413528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856f08-e328-4384-8924-b35a78e64e5d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-7c856f08-e328-4384-8924-b35a78e64e5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:56.428084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:56.429081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:56.430027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:56.430027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:56.430027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:56.430027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:56.430027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:56.430027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:56.430027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:56.430027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:56.430027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:19:56.430027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:56.432803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3bedc-b5d9-454b-bc73-d2e8986385ba None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:56.432884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 310/616] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:19:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:56.440048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856f08-e328-4384-8924-b35a78e64e5d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:56.618637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3bedc-b5d9-454b-bc73-d2e8986385ba None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:56.629772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:56.636397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856f08-e328-4384-8924-b35a78e64e5d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:56.657315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:56.684307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e8c2-7688-43ee-a230-cfea492aa866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:56.684937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e8c2-7688-43ee-a230-cfea492aa866 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:56.685232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e8c2-7688-43ee-a230-cfea492aa866 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:56.685499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e8c2-7688-43ee-a230-cfea492aa866 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:56.694818 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6947e4-a07e-4ddc-99d5-e2a2f99019ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:56.695429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6947e4-a07e-4ddc-99d5-e2a2f99019ea None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:56.695708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6947e4-a07e-4ddc-99d5-e2a2f99019ea None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:56.696023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6947e4-a07e-4ddc-99d5-e2a2f99019ea None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:56.696751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6947e4-a07e-4ddc-99d5-e2a2f99019ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:56.697082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6947e4-a07e-4ddc-99d5-e2a2f99019ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:56.698503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6947e4-a07e-4ddc-99d5-e2a2f99019ea None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:56.705911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353e8c2-7688-43ee-a230-cfea492aa866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4353e8c2-7688-43ee-a230-cfea492aa866 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:56.711201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:56.712692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:56.713540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:56.717512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 307/617] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:56.718344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e8c2-7688-43ee-a230-cfea492aa866 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:56.739168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 311/618] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 10:19:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:56.740411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9099-2982-463b-bd78-4ab901e0e512 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:56.740688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9099-2982-463b-bd78-4ab901e0e512 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:56.740979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9099-2982-463b-bd78-4ab901e0e512 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:56.742158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 312/619] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:56.745233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9099-2982-463b-bd78-4ab901e0e512 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:56.841707 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e8c2-7688-43ee-a230-cfea492aa866 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:56.875208 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2d991-7f9a-454b-8225-24b3d8469f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:56.875735 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d991-7f9a-454b-8225-24b3d8469f51 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:56.876012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d991-7f9a-454b-8225-24b3d8469f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:56.876283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d991-7f9a-454b-8225-24b3d8469f51 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:56.877073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2d991-7f9a-454b-8225-24b3d8469f51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:56.877423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9099-2982-463b-bd78-4ab901e0e512 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:56.877589 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2d991-7f9a-454b-8225-24b3d8469f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:56.878783 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2d991-7f9a-454b-8225-24b3d8469f51 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:56.891576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 308/620] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:56.892879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d55f-afed-49fa-9fe0-547f83d6b337 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:56.893204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d55f-afed-49fa-9fe0-547f83d6b337 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:56.893476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d55f-afed-49fa-9fe0-547f83d6b337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:56.911895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c814d55f-afed-49fa-9fe0-547f83d6b337 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:56.913092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c814d55f-afed-49fa-9fe0-547f83d6b337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:56.917403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d108184-ea5d-41ef-8a33-89a64bb8ed9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:56.918027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d108184-ea5d-41ef-8a33-89a64bb8ed9b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:56.921163 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d108184-ea5d-41ef-8a33-89a64bb8ed9b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:56.921683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d108184-ea5d-41ef-8a33-89a64bb8ed9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:56.935985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d108184-ea5d-41ef-8a33-89a64bb8ed9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:56.938160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d108184-ea5d-41ef-8a33-89a64bb8ed9b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-9d108184-ea5d-41ef-8a33-89a64bb8ed9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:56.956749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:56.957868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:56.958754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:56.958754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:56.958754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:56.958937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:56.965269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 313/621] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:56.965905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d108184-ea5d-41ef-8a33-89a64bb8ed9b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:56.977621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:57.002394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 309/622] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:57.002394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814d55f-afed-49fa-9fe0-547f83d6b337 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:57.167328 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d108184-ea5d-41ef-8a33-89a64bb8ed9b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:57.168780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814d55f-afed-49fa-9fe0-547f83d6b337 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:57.208435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4029b73-c9e0-4673-81ae-77cee37c0fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:57.209061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4029b73-c9e0-4673-81ae-77cee37c0fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.209344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4029b73-c9e0-4673-81ae-77cee37c0fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.209613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4029b73-c9e0-4673-81ae-77cee37c0fb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.210610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4029b73-c9e0-4673-81ae-77cee37c0fb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:57.210911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4029b73-c9e0-4673-81ae-77cee37c0fb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:57.212351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4029b73-c9e0-4673-81ae-77cee37c0fb9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:57.225234 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 310/623] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:57.231109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4029b73-c9e0-4673-81ae-77cee37c0fb9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:57.248417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdf0ae-76e5-43a1-b72f-061485d84299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:57.249836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdf0ae-76e5-43a1-b72f-061485d84299 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.250396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdf0ae-76e5-43a1-b72f-061485d84299 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.250665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdf0ae-76e5-43a1-b72f-061485d84299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.274288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdf0ae-76e5-43a1-b72f-061485d84299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:57.276600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdf0ae-76e5-43a1-b72f-061485d84299 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:57.295250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1bfdf0ae-76e5-43a1-b72f-061485d84299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:57.306516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:57.307482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:57.308356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:57.308356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:57.308356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:57.308356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 314/624] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:57.317500 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdf0ae-76e5-43a1-b72f-061485d84299 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:57.402526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:57.419781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4029b73-c9e0-4673-81ae-77cee37c0fb9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:57.457486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c499b-b0ef-461a-9c7a-8447b5db225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:57.458130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c499b-b0ef-461a-9c7a-8447b5db225d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.458570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c499b-b0ef-461a-9c7a-8447b5db225d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.458774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c499b-b0ef-461a-9c7a-8447b5db225d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.466968 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c499b-b0ef-461a-9c7a-8447b5db225d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:57.468580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c499b-b0ef-461a-9c7a-8447b5db225d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:57.470220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdf0ae-76e5-43a1-b72f-061485d84299 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-715c499b-b0ef-461a-9c7a-8447b5db225d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:57.481080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:57.482015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:57.482924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:57.482924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:57.482924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:57.482924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:57.482924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:57.482924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:57.482924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:57.482924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:57.487132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 311/625] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:57.488004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c499b-b0ef-461a-9c7a-8447b5db225d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:57.517978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0e12f-204a-4e7a-95da-de4af4dbfffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:57.519614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e12f-204a-4e7a-95da-de4af4dbfffd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.520084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e12f-204a-4e7a-95da-de4af4dbfffd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.520566 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e12f-204a-4e7a-95da-de4af4dbfffd None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.522009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0e12f-204a-4e7a-95da-de4af4dbfffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:57.522643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0e12f-204a-4e7a-95da-de4af4dbfffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:57.524785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0e12f-204a-4e7a-95da-de4af4dbfffd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:57.542638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 315/626] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:19:57.543747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0e12f-204a-4e7a-95da-de4af4dbfffd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:57.594834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:57.605122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c499b-b0ef-461a-9c7a-8447b5db225d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:57.643876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe331c-d232-499f-84cf-c90c71bac480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:57.644909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe331c-d232-499f-84cf-c90c71bac480 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.645216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe331c-d232-499f-84cf-c90c71bac480 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.645488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe331c-d232-499f-84cf-c90c71bac480 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.656202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0e12f-204a-4e7a-95da-de4af4dbfffd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:57.659193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe331c-d232-499f-84cf-c90c71bac480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-88fe331c-d232-499f-84cf-c90c71bac480 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:57.664939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:57.665855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:57.666660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:57.667371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 312/627] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:57.668008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe331c-d232-499f-84cf-c90c71bac480 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:57.677030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:57.696712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d4ec2-bc4a-48de-a049-777e75230fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:57.697357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4ec2-bc4a-48de-a049-777e75230fcc None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.697636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4ec2-bc4a-48de-a049-777e75230fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.697903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4ec2-bc4a-48de-a049-777e75230fcc None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.698579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d4ec2-bc4a-48de-a049-777e75230fcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:57.698881 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d4ec2-bc4a-48de-a049-777e75230fcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:57.700303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d4ec2-bc4a-48de-a049-777e75230fcc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:57.711344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 316/628] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:57.712568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124223-52da-469d-9cfd-0654b3eb9706 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.712789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124223-52da-469d-9cfd-0654b3eb9706 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.713091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124223-52da-469d-9cfd-0654b3eb9706 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.714264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 317/629] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:57.714935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50124223-52da-469d-9cfd-0654b3eb9706 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:57.774069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe331c-d232-499f-84cf-c90c71bac480 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:57.807709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1a6e2-f466-41af-b150-7a55ad808c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:57.808325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1a6e2-f466-41af-b150-7a55ad808c4b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.808600 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1a6e2-f466-41af-b150-7a55ad808c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.808869 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1a6e2-f466-41af-b150-7a55ad808c4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.816148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1a6e2-f466-41af-b150-7a55ad808c4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:57.816266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50124223-52da-469d-9cfd-0654b3eb9706 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:57.817608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1a6e2-f466-41af-b150-7a55ad808c4b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-50d1a6e2-f466-41af-b150-7a55ad808c4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:57.828404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:57.829412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 313/630] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 10:19:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4cb5-3bbe-4e0f-975f-52149498852a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.831074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4cb5-3bbe-4e0f-975f-52149498852a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.831801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4cb5-3bbe-4e0f-975f-52149498852a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.832377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 314/631] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:19:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:19:57.832922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4cb5-3bbe-4e0f-975f-52149498852a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:57.847589 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:57.854328 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dfe23-4b7b-446f-b0f6-22be15ca7b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:57.855013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dfe23-4b7b-446f-b0f6-22be15ca7b5b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.855363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dfe23-4b7b-446f-b0f6-22be15ca7b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.855704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dfe23-4b7b-446f-b0f6-22be15ca7b5b None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.856440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dfe23-4b7b-446f-b0f6-22be15ca7b5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:57.856750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dfe23-4b7b-446f-b0f6-22be15ca7b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:57.858154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dfe23-4b7b-446f-b0f6-22be15ca7b5b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:57.865950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 318/632] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:57.867106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f806-3183-4d86-b781-eac2f85fb7b6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.867444 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f806-3183-4d86-b781-eac2f85fb7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.867688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f806-3183-4d86-b781-eac2f85fb7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.885160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6ed9f806-3183-4d86-b781-eac2f85fb7b6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:57.886349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6ed9f806-3183-4d86-b781-eac2f85fb7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:57.919868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:57.937293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4cb5-3bbe-4e0f-975f-52149498852a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:57.952090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 319/633] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:57.952921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9f806-3183-4d86-b781-eac2f85fb7b6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:57.969828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f3895-3cd3-450c-9d97-ea4d03af6fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:57.970491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f3895-3cd3-450c-9d97-ea4d03af6fac None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:57.970772 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f3895-3cd3-450c-9d97-ea4d03af6fac None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:57.971050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f3895-3cd3-450c-9d97-ea4d03af6fac None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/e5b380b92dc5438c92380c3fe2406590/roles/c2bcddceaa5642beb73d7d1012bd46ec` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:57.988179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f3895-3cd3-450c-9d97-ea4d03af6fac None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=e5b380b92dc5438c92380c3fe2406590, role_id=c2bcddceaa5642beb73d7d1012bd46ec)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:57.989935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f3895-3cd3-450c-9d97-ea4d03af6fac None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:58.014028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 315/634] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:19:57 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/e5b380b92dc5438c92380c3fe2406590/roles/c2bcddceaa5642beb73d7d1012bd46ec => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:19:58.014028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318419c-be03-46ef-a71c-68e2073f1730 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:58.014028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318419c-be03-46ef-a71c-68e2073f1730 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:58.014028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318419c-be03-46ef-a71c-68e2073f1730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:58.034203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b318419c-be03-46ef-a71c-68e2073f1730 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:19:58.036271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b318419c-be03-46ef-a71c-68e2073f1730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:19:58.091198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9f806-3183-4d86-b781-eac2f85fb7b6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:58.110035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:58.129836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 316/635] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:19:58.131113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318419c-be03-46ef-a71c-68e2073f1730 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:58.134095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4647a-23aa-49a5-92a8-bce091a62cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:58.134713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4647a-23aa-49a5-92a8-bce091a62cbb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:58.134992 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4647a-23aa-49a5-92a8-bce091a62cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:58.135272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4647a-23aa-49a5-92a8-bce091a62cbb None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:58.136050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4647a-23aa-49a5-92a8-bce091a62cbb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:58.136356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4647a-23aa-49a5-92a8-bce091a62cbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:58.139656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4647a-23aa-49a5-92a8-bce091a62cbb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:58.161101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 320/636] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 10:19:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:58.166891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4647a-23aa-49a5-92a8-bce091a62cbb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:58.202055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:58.286747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318419c-be03-46ef-a71c-68e2073f1730 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:58.288184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4647a-23aa-49a5-92a8-bce091a62cbb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:58.326323 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb45336-73bc-4ee7-a594-b80b91ed9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:58.326756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ee851-62d3-46e4-a8e5-f4381eb83efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:58.327430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ee851-62d3-46e4-a8e5-f4381eb83efe None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:58.327719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb45336-73bc-4ee7-a594-b80b91ed9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:58.327841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ee851-62d3-46e4-a8e5-f4381eb83efe None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:58.328111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ee851-62d3-46e4-a8e5-f4381eb83efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:58.328462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb45336-73bc-4ee7-a594-b80b91ed9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:58.328906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb45336-73bc-4ee7-a594-b80b91ed9ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:58.342555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb45336-73bc-4ee7-a594-b80b91ed9ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:58.344926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb45336-73bc-4ee7-a594-b80b91ed9ee9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8eb45336-73bc-4ee7-a594-b80b91ed9ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:58.369811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:58.370744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:58.371622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:58.371622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:58.371622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:58.373977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 317/637] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:58.375251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb45336-73bc-4ee7-a594-b80b91ed9ee9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:58.411219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ee851-62d3-46e4-a8e5-f4381eb83efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:58.413642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ee851-62d3-46e4-a8e5-f4381eb83efe None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:58.429574 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:58.450002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:58.490534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb45336-73bc-4ee7-a594-b80b91ed9ee9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:58.532433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 321/638] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:58.532621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9078f0-a654-4532-8466-c9de2492a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:58.532621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9078f0-a654-4532-8466-c9de2492a23a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:58.532792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ee851-62d3-46e4-a8e5-f4381eb83efe None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:58.532883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9078f0-a654-4532-8466-c9de2492a23a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:58.532883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9078f0-a654-4532-8466-c9de2492a23a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:58.546357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9078f0-a654-4532-8466-c9de2492a23a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ea9078f0-a654-4532-8466-c9de2492a23a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:58.553432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:58.554371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:58.555222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:58.556473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 318/639] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:58.557109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9078f0-a654-4532-8466-c9de2492a23a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:58.643354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ee851-62d3-46e4-a8e5-f4381eb83efe None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:58.665276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9078f0-a654-4532-8466-c9de2492a23a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:58.669102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:58.671044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:58.679455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf58ef-031f-4976-90bd-b2d5e9a95040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:58.680061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf58ef-031f-4976-90bd-b2d5e9a95040 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:58.680895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf58ef-031f-4976-90bd-b2d5e9a95040 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:58.681197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf58ef-031f-4976-90bd-b2d5e9a95040 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:58.681831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf58ef-031f-4976-90bd-b2d5e9a95040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:58.682131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf58ef-031f-4976-90bd-b2d5e9a95040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:58.683472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf58ef-031f-4976-90bd-b2d5e9a95040 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:58.694849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 322/640] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:58.695635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf58ef-031f-4976-90bd-b2d5e9a95040 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:58.713785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2737b-5948-49f5-90f9-9297e1f356ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:58.714636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2737b-5948-49f5-90f9-9297e1f356ad None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:58.715071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2737b-5948-49f5-90f9-9297e1f356ad None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:58.715343 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2737b-5948-49f5-90f9-9297e1f356ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:58.726168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2737b-5948-49f5-90f9-9297e1f356ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-44e2737b-5948-49f5-90f9-9297e1f356ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:19:58.731937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:58.732834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 319/641] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:58.737876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2737b-5948-49f5-90f9-9297e1f356ad None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:58.808805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf58ef-031f-4976-90bd-b2d5e9a95040 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:58.844257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcb179-4b64-47d2-8f9b-a455b84116a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:58.844883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcb179-4b64-47d2-8f9b-a455b84116a2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:58.845207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcb179-4b64-47d2-8f9b-a455b84116a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:58.845479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcb179-4b64-47d2-8f9b-a455b84116a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:58.850282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2737b-5948-49f5-90f9-9297e1f356ad None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:58.856827 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcb179-4b64-47d2-8f9b-a455b84116a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:58.858274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcb179-4b64-47d2-8f9b-a455b84116a2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-e7dcb179-4b64-47d2-8f9b-a455b84116a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:58.872717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:58.873744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:58.874629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:58.874629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:58.874629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:58.874629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 323/642] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:58.874629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcb179-4b64-47d2-8f9b-a455b84116a2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:58.892503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a62c6f-6c97-47bc-b193-a0f37bd53dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:58.893149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62c6f-6c97-47bc-b193-a0f37bd53dba None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:58.893426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62c6f-6c97-47bc-b193-a0f37bd53dba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:58.893696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62c6f-6c97-47bc-b193-a0f37bd53dba None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:58.894350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a62c6f-6c97-47bc-b193-a0f37bd53dba None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:58.894651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a62c6f-6c97-47bc-b193-a0f37bd53dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:58.895995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a62c6f-6c97-47bc-b193-a0f37bd53dba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:58.905252 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 320/643] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:58.906060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a62c6f-6c97-47bc-b193-a0f37bd53dba None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:58.926946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:58.935988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:58.991000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcb179-4b64-47d2-8f9b-a455b84116a2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.013651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a62c6f-6c97-47bc-b193-a0f37bd53dba None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.023783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcf700-d035-427b-819d-b50c45aff359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.025157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcf700-d035-427b-819d-b50c45aff359 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.025440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcf700-d035-427b-819d-b50c45aff359 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.025712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcf700-d035-427b-819d-b50c45aff359 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.033302 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcf700-d035-427b-819d-b50c45aff359 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.034728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcf700-d035-427b-819d-b50c45aff359 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-3ffcf700-d035-427b-819d-b50c45aff359 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:19:59.046450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:59.047359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:59.048421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 324/644] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:59.049715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcf700-d035-427b-819d-b50c45aff359 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:59.051753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28d954-cdc2-4da7-a8f5-f82cbd00f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.052353 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28d954-cdc2-4da7-a8f5-f82cbd00f848 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.052628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28d954-cdc2-4da7-a8f5-f82cbd00f848 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.052896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28d954-cdc2-4da7-a8f5-f82cbd00f848 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.053580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28d954-cdc2-4da7-a8f5-f82cbd00f848 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:59.053877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28d954-cdc2-4da7-a8f5-f82cbd00f848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.055237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28d954-cdc2-4da7-a8f5-f82cbd00f848 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.063678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 321/645] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:59.064378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28d954-cdc2-4da7-a8f5-f82cbd00f848 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:59.156783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:59.158473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:59.160206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcf700-d035-427b-819d-b50c45aff359 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.173143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28d954-cdc2-4da7-a8f5-f82cbd00f848 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.197569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46523e2-8d88-4342-b26f-178271ba59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.198010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46523e2-8d88-4342-b26f-178271ba59a7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.198310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46523e2-8d88-4342-b26f-178271ba59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.198585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46523e2-8d88-4342-b26f-178271ba59a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.199220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46523e2-8d88-4342-b26f-178271ba59a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:59.199522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46523e2-8d88-4342-b26f-178271ba59a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.200873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46523e2-8d88-4342-b26f-178271ba59a7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.209270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16206-c7f0-42a1-9029-00ceb8e03c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.210060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16206-c7f0-42a1-9029-00ceb8e03c6d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.210499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16206-c7f0-42a1-9029-00ceb8e03c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.210913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba16206-c7f0-42a1-9029-00ceb8e03c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.213075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 325/646] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:59.213857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46523e2-8d88-4342-b26f-178271ba59a7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:59.226442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba16206-c7f0-42a1-9029-00ceb8e03c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.227921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba16206-c7f0-42a1-9029-00ceb8e03c6d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3ba16206-c7f0-42a1-9029-00ceb8e03c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:59.242596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:59.243957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:59.244840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:59.244840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:59.244840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:59.244840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 322/647] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:59.244840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16206-c7f0-42a1-9029-00ceb8e03c6d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:59.323945 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46523e2-8d88-4342-b26f-178271ba59a7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.357701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba16206-c7f0-42a1-9029-00ceb8e03c6d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.362596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42883dc6-bfe0-4308-a9c6-573894dfaa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.363409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42883dc6-bfe0-4308-a9c6-573894dfaa07 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.363858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42883dc6-bfe0-4308-a9c6-573894dfaa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.364332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42883dc6-bfe0-4308-a9c6-573894dfaa07 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.365262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42883dc6-bfe0-4308-a9c6-573894dfaa07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:59.365772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42883dc6-bfe0-4308-a9c6-573894dfaa07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.368013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42883dc6-bfe0-4308-a9c6-573894dfaa07 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.385495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 326/648] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:59.386123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42883dc6-bfe0-4308-a9c6-573894dfaa07 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:59.397628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97caed-fbf9-4c3b-8075-8ccfc5abd1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.398263 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97caed-fbf9-4c3b-8075-8ccfc5abd1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.398544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97caed-fbf9-4c3b-8075-8ccfc5abd1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.398816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97caed-fbf9-4c3b-8075-8ccfc5abd1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.404708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:59.409721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:59.412225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97caed-fbf9-4c3b-8075-8ccfc5abd1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.414053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97caed-fbf9-4c3b-8075-8ccfc5abd1a0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9e97caed-fbf9-4c3b-8075-8ccfc5abd1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:19:59.434286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:59.435264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:19:59.436130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:19:59.436130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:19:59.436130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:19:59.436130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 323/649] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:59.436130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97caed-fbf9-4c3b-8075-8ccfc5abd1a0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:59.491722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42883dc6-bfe0-4308-a9c6-573894dfaa07 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.526580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386afaf-c528-4ccd-a0e1-42f407ad648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.527204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386afaf-c528-4ccd-a0e1-42f407ad648e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.527486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386afaf-c528-4ccd-a0e1-42f407ad648e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.527758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386afaf-c528-4ccd-a0e1-42f407ad648e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.534468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386afaf-c528-4ccd-a0e1-42f407ad648e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.535887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386afaf-c528-4ccd-a0e1-42f407ad648e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.540476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97caed-fbf9-4c3b-8075-8ccfc5abd1a0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a386afaf-c528-4ccd-a0e1-42f407ad648e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:19:59.546965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:19:59.547927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:19:59.548829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:19:59.548829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:19:59.548829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:19:59.548829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:19:59.548829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:19:59.548829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:19:59.548829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:19:59.548829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:19:59.548829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 327/650] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:19:59.548829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386afaf-c528-4ccd-a0e1-42f407ad648e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:59.583898 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40db78-d385-4a21-9e40-fa6b3cab41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.584507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40db78-d385-4a21-9e40-fa6b3cab41d5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.584788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40db78-d385-4a21-9e40-fa6b3cab41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.585104 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40db78-d385-4a21-9e40-fa6b3cab41d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.585843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40db78-d385-4a21-9e40-fa6b3cab41d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:59.586047 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40db78-d385-4a21-9e40-fa6b3cab41d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.588207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40db78-d385-4a21-9e40-fa6b3cab41d5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.605849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 324/651] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:59.605849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40db78-d385-4a21-9e40-fa6b3cab41d5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:59.642304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:59.660008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:59.665627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386afaf-c528-4ccd-a0e1-42f407ad648e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.703723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecce20-c4a7-4734-ae59-0030ba8e4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.704487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecce20-c4a7-4734-ae59-0030ba8e4cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.704769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecce20-c4a7-4734-ae59-0030ba8e4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.705075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecce20-c4a7-4734-ae59-0030ba8e4cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.710761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40db78-d385-4a21-9e40-fa6b3cab41d5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.749370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0add4b3-14bc-4011-a130-57c0165a8932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.749370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0add4b3-14bc-4011-a130-57c0165a8932 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.749864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0add4b3-14bc-4011-a130-57c0165a8932 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.750407 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0add4b3-14bc-4011-a130-57c0165a8932 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.750917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0add4b3-14bc-4011-a130-57c0165a8932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:59.751287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0add4b3-14bc-4011-a130-57c0165a8932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.752749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0add4b3-14bc-4011-a130-57c0165a8932 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.765315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 325/652] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:59.766200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0add4b3-14bc-4011-a130-57c0165a8932 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:59.787434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecce20-c4a7-4734-ae59-0030ba8e4cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.788877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecce20-c4a7-4734-ae59-0030ba8e4cf5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.875148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0add4b3-14bc-4011-a130-57c0165a8932 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:19:59.881973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:59.889808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:19:59.912262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bed75f-ac2d-4226-a1c3-808a6241914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:19:59.912865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bed75f-ac2d-4226-a1c3-808a6241914c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:19:59.913399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bed75f-ac2d-4226-a1c3-808a6241914c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:19:59.913507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bed75f-ac2d-4226-a1c3-808a6241914c None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:19:59.913582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 328/653] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:19:59.914112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bed75f-ac2d-4226-a1c3-808a6241914c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:19:59.914397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecce20-c4a7-4734-ae59-0030ba8e4cf5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:19:59.914511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bed75f-ac2d-4226-a1c3-808a6241914c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:19:59.915849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bed75f-ac2d-4226-a1c3-808a6241914c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:19:59.933895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 326/654] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:19:59.933895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bed75f-ac2d-4226-a1c3-808a6241914c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:00.029334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecce20-c4a7-4734-ae59-0030ba8e4cf5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:00.043001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bed75f-ac2d-4226-a1c3-808a6241914c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:00.066176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99c819-d725-481f-aa67-ddb756dc1e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:00.066873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c819-d725-481f-aa67-ddb756dc1e1d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.067161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c819-d725-481f-aa67-ddb756dc1e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.067436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c819-d725-481f-aa67-ddb756dc1e1d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.074745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99c819-d725-481f-aa67-ddb756dc1e1d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:00.076175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99c819-d725-481f-aa67-ddb756dc1e1d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:00.079041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152ce3e-09ec-4081-826c-6c856babafa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:00.079681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152ce3e-09ec-4081-826c-6c856babafa5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.079964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152ce3e-09ec-4081-826c-6c856babafa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.080239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152ce3e-09ec-4081-826c-6c856babafa5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6e99c819-d725-481f-aa67-ddb756dc1e1d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:00.088321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:00.089637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:00.091087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:00.091087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:00.091087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:00.091087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:00.091087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:00.091087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:00.091087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:00.091087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:00.091087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 10:20:00.091087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:00.091638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152ce3e-09ec-4081-826c-6c856babafa5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:00.091638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152ce3e-09ec-4081-826c-6c856babafa5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:00.094451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 329/655] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:00.095230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99c819-d725-481f-aa67-ddb756dc1e1d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a152ce3e-09ec-4081-826c-6c856babafa5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:00.104225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:00.105571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 327/656] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:19:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:00.106494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152ce3e-09ec-4081-826c-6c856babafa5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:00.143881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:00.146355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:00.212196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99c819-d725-481f-aa67-ddb756dc1e1d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:00.219792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152ce3e-09ec-4081-826c-6c856babafa5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:00.246402 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e74288-e03c-4307-90e6-e159d7af8e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:00.247209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e74288-e03c-4307-90e6-e159d7af8e85 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.247672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e74288-e03c-4307-90e6-e159d7af8e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.247942 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e74288-e03c-4307-90e6-e159d7af8e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.252580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18b4b8-a8b3-4329-8db8-898960cea5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:00.253196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18b4b8-a8b3-4329-8db8-898960cea5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.253474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18b4b8-a8b3-4329-8db8-898960cea5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.253742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18b4b8-a8b3-4329-8db8-898960cea5e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.254447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18b4b8-a8b3-4329-8db8-898960cea5e2 None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=e58300ef26a547028e837ba2da615991) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:00.254748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18b4b8-a8b3-4329-8db8-898960cea5e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:00.256152 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18b4b8-a8b3-4329-8db8-898960cea5e2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:00.257537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e74288-e03c-4307-90e6-e159d7af8e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:00.258937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e74288-e03c-4307-90e6-e159d7af8e85 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:00.261785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 328/657] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:00 2022] GET /identity/v3/role_assignments?user.id=e58300ef26a547028e837ba2da615991&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:00.262545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18b4b8-a8b3-4329-8db8-898960cea5e2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-93e74288-e03c-4307-90e6-e159d7af8e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:00.273822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:00.274911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:00.276132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:00.276132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:00.276132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:00.280038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 330/658] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:00.281075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e74288-e03c-4307-90e6-e159d7af8e85 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:00.382999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:00.390061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18b4b8-a8b3-4329-8db8-898960cea5e2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:00.403591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:00.416119 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e74288-e03c-4307-90e6-e159d7af8e85 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:00.428273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af165f53-f7cd-4eb8-a555-1fe0c351272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:00.428874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af165f53-f7cd-4eb8-a555-1fe0c351272e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.429181 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af165f53-f7cd-4eb8-a555-1fe0c351272e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.429449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af165f53-f7cd-4eb8-a555-1fe0c351272e None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.430207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af165f53-f7cd-4eb8-a555-1fe0c351272e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:00.430516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af165f53-f7cd-4eb8-a555-1fe0c351272e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:00.431938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af165f53-f7cd-4eb8-a555-1fe0c351272e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:00.451414 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 329/659] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 10:20:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:00.452610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adf185-98cc-4151-a56f-df1fe9d447df None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.452898 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adf185-98cc-4151-a56f-df1fe9d447df None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.453220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adf185-98cc-4151-a56f-df1fe9d447df None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.454517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 330/660] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:00.455617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adf185-98cc-4151-a56f-df1fe9d447df None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:00.463836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbbf21-2084-4641-8dc6-ea5f0508756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:00.464451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbbf21-2084-4641-8dc6-ea5f0508756e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.464733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbbf21-2084-4641-8dc6-ea5f0508756e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.465091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbbf21-2084-4641-8dc6-ea5f0508756e None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.465833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbbf21-2084-4641-8dc6-ea5f0508756e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:00.466136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbbf21-2084-4641-8dc6-ea5f0508756e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:00.467546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbbf21-2084-4641-8dc6-ea5f0508756e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:00.488871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 331/661] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Sep 26 10:20:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:00.490272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc19a2-441e-479d-9ae8-40aa7e00c8e2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.490554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc19a2-441e-479d-9ae8-40aa7e00c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.490825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc19a2-441e-479d-9ae8-40aa7e00c8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.510707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-20dc19a2-441e-479d-9ae8-40aa7e00c8e2 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:00.512851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-20dc19a2-441e-479d-9ae8-40aa7e00c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:00.569273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adf185-98cc-4151-a56f-df1fe9d447df None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:00.585114 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 332/662] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:20:00.585314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc19a2-441e-479d-9ae8-40aa7e00c8e2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:00.611582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c57a90-a23a-439c-8600-326342a93bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:00.612421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c57a90-a23a-439c-8600-326342a93bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.612850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c57a90-a23a-439c-8600-326342a93bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.613293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c57a90-a23a-439c-8600-326342a93bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.614100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c57a90-a23a-439c-8600-326342a93bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:00.614549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c57a90-a23a-439c-8600-326342a93bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:00.616046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c57a90-a23a-439c-8600-326342a93bf3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:00.627879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 331/663] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:00.628938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c57a90-a23a-439c-8600-326342a93bf3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:00.646395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:00.701488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:00.729990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc19a2-441e-479d-9ae8-40aa7e00c8e2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:00.745092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c57a90-a23a-439c-8600-326342a93bf3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:00.772291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1384fc0-423d-4000-8f03-797029271815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:00.773418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1384fc0-423d-4000-8f03-797029271815 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.774584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1384fc0-423d-4000-8f03-797029271815 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.775070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1384fc0-423d-4000-8f03-797029271815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.783934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3436-b216-4963-aa4d-ce83384ca8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:00.784684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3436-b216-4963-aa4d-ce83384ca8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:00.785077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3436-b216-4963-aa4d-ce83384ca8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:00.785502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3436-b216-4963-aa4d-ce83384ca8a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:00.858985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1384fc0-423d-4000-8f03-797029271815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:00.860848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1384fc0-423d-4000-8f03-797029271815 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:00.863709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b3436-b216-4963-aa4d-ce83384ca8a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:00.865339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b3436-b216-4963-aa4d-ce83384ca8a5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:00.881215 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:00.960002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:00.974642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 332/664] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:20:00.975819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3436-b216-4963-aa4d-ce83384ca8a5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:00.992995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 333/665] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:20:00.993540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1384fc0-423d-4000-8f03-797029271815 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.088034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b3436-b216-4963-aa4d-ce83384ca8a5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:01.102759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:01.106647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1384fc0-423d-4000-8f03-797029271815 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:01.125689 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f3ac-902b-4bae-bab3-ba972052f4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:01.126319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f3ac-902b-4bae-bab3-ba972052f4bc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:01.126602 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f3ac-902b-4bae-bab3-ba972052f4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:01.126874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f3ac-902b-4bae-bab3-ba972052f4bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:01.135165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8f3ac-902b-4bae-bab3-ba972052f4bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:01.136613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8f3ac-902b-4bae-bab3-ba972052f4bc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:01.147828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863e792-013c-4a60-bf38-b0db83b816ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e0f8f3ac-902b-4bae-bab3-ba972052f4bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:01.148031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:01.149079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:01.149956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:01.149956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:01.149956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:01.149956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:01.149956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:01.149956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:01.149956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:01.149956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:01.149956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 333/666] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:01.149956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f3ac-902b-4bae-bab3-ba972052f4bc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.151444 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863e792-013c-4a60-bf38-b0db83b816ce None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:01.151725 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863e792-013c-4a60-bf38-b0db83b816ce None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:01.151997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863e792-013c-4a60-bf38-b0db83b816ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:01.166612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863e792-013c-4a60-bf38-b0db83b816ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d863e792-013c-4a60-bf38-b0db83b816ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:01.173003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:01.173919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:01.174806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 334/667] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:20:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:01.176169 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863e792-013c-4a60-bf38-b0db83b816ce None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.218277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:01.269280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f3ac-902b-4bae-bab3-ba972052f4bc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:01.289242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863e792-013c-4a60-bf38-b0db83b816ce None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:01.309020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3a27c-5fab-43cb-be84-21c15ca4cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:01.309651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3a27c-5fab-43cb-be84-21c15ca4cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:01.309926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3a27c-5fab-43cb-be84-21c15ca4cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:01.310195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3a27c-5fab-43cb-be84-21c15ca4cfa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:01.322628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3a27c-5fab-43cb-be84-21c15ca4cfa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:01.324048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3a27c-5fab-43cb-be84-21c15ca4cfa7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:01.325774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343e9a7-1905-4f4c-bd75-87c91438b90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:01.326623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343e9a7-1905-4f4c-bd75-87c91438b90c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:01.326741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343e9a7-1905-4f4c-bd75-87c91438b90c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:01.326944 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343e9a7-1905-4f4c-bd75-87c91438b90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:01.337259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343e9a7-1905-4f4c-bd75-87c91438b90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:01.338690 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343e9a7-1905-4f4c-bd75-87c91438b90c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d7a3a27c-5fab-43cb-be84-21c15ca4cfa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:01.338941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:01.339812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:01.340682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:01.340682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:01.340682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:01.340682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 334/668] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:01.341396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3a27c-5fab-43cb-be84-21c15ca4cfa7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d343e9a7-1905-4f4c-bd75-87c91438b90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:01.363246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:01.364250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:01.365212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:01.365212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:01.365212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:01.369327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 335/669] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:01.370282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343e9a7-1905-4f4c-bd75-87c91438b90c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.376208 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:01.455774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3a27c-5fab-43cb-be84-21c15ca4cfa7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:01.464128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:01.476445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343e9a7-1905-4f4c-bd75-87c91438b90c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:01.490832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88469515-933f-42b7-a22b-3f874f6f2b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:01.491787 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88469515-933f-42b7-a22b-3f874f6f2b3b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:01.491787 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88469515-933f-42b7-a22b-3f874f6f2b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:01.492071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88469515-933f-42b7-a22b-3f874f6f2b3b None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:01.493413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88469515-933f-42b7-a22b-3f874f6f2b3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:01.493720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88469515-933f-42b7-a22b-3f874f6f2b3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:01.495352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88469515-933f-42b7-a22b-3f874f6f2b3b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:01.508442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 335/670] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:01.509262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88469515-933f-42b7-a22b-3f874f6f2b3b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.516697 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29020fbb-cc5f-4076-8384-d379efe626fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:01.517374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29020fbb-cc5f-4076-8384-d379efe626fd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:01.517643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29020fbb-cc5f-4076-8384-d379efe626fd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:01.517916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29020fbb-cc5f-4076-8384-d379efe626fd None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:01.518578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29020fbb-cc5f-4076-8384-d379efe626fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:01.518880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29020fbb-cc5f-4076-8384-d379efe626fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:01.520244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29020fbb-cc5f-4076-8384-d379efe626fd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:01.533124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 336/671] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:20:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:01.533124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29020fbb-cc5f-4076-8384-d379efe626fd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.604724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:01.620180 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88469515-933f-42b7-a22b-3f874f6f2b3b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:01.642751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29020fbb-cc5f-4076-8384-d379efe626fd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:01.654853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a57425-1b6b-406b-bee1-8eac330c7934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:01.655809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a57425-1b6b-406b-bee1-8eac330c7934 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:01.656099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a57425-1b6b-406b-bee1-8eac330c7934 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:01.656366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a57425-1b6b-406b-bee1-8eac330c7934 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:01.657077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a57425-1b6b-406b-bee1-8eac330c7934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:01.657382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a57425-1b6b-406b-bee1-8eac330c7934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:01.658734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a57425-1b6b-406b-bee1-8eac330c7934 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:01.674706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 336/672] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:01.674706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a57425-1b6b-406b-bee1-8eac330c7934 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.685512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caece9d-2d41-4790-b633-27c416f938a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:01.686433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caece9d-2d41-4790-b633-27c416f938a0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:01.686870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caece9d-2d41-4790-b633-27c416f938a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:01.687149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caece9d-2d41-4790-b633-27c416f938a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:01.687789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caece9d-2d41-4790-b633-27c416f938a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:01.688096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caece9d-2d41-4790-b633-27c416f938a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:01.689507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caece9d-2d41-4790-b633-27c416f938a0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:01.701366 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 337/673] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:01.702131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caece9d-2d41-4790-b633-27c416f938a0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.718330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:01.782510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a57425-1b6b-406b-bee1-8eac330c7934 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:01.802960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caece9d-2d41-4790-b633-27c416f938a0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:01.820413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad467d-a92c-47e7-8b49-38c24ec8c47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:01.821754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad467d-a92c-47e7-8b49-38c24ec8c47d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:01.822179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad467d-a92c-47e7-8b49-38c24ec8c47d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:01.822998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad467d-a92c-47e7-8b49-38c24ec8c47d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:01.824133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad467d-a92c-47e7-8b49-38c24ec8c47d None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=dcfef506919f4914a7883bd99ea07615) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:01.824627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad467d-a92c-47e7-8b49-38c24ec8c47d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:01.827042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad467d-a92c-47e7-8b49-38c24ec8c47d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:01.834193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 337/674] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:01 2022] GET /identity/v3/role_assignments?user.id=dcfef506919f4914a7883bd99ea07615&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:01.835438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad467d-a92c-47e7-8b49-38c24ec8c47d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.846256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926ba87-1632-4967-918b-7c4ad1390325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:01.847202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926ba87-1632-4967-918b-7c4ad1390325 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:01.847626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926ba87-1632-4967-918b-7c4ad1390325 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:01.848047 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926ba87-1632-4967-918b-7c4ad1390325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:01.862741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926ba87-1632-4967-918b-7c4ad1390325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:01.864207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926ba87-1632-4967-918b-7c4ad1390325 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:01.866664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-3926ba87-1632-4967-918b-7c4ad1390325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:01.885913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:01.886930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:01.887816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:01.887816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:01.887816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:01.890209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 338/675] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:01.891320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926ba87-1632-4967-918b-7c4ad1390325 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:01.961105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:01.986193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad467d-a92c-47e7-8b49-38c24ec8c47d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:02.009436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926ba87-1632-4967-918b-7c4ad1390325 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:02.040596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100d092-f29c-423f-a10d-fccf6fbac326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:02.041786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100d092-f29c-423f-a10d-fccf6fbac326 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.042065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100d092-f29c-423f-a10d-fccf6fbac326 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.042337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100d092-f29c-423f-a10d-fccf6fbac326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.049490 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100d092-f29c-423f-a10d-fccf6fbac326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:02.050671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb5c2-cd51-4de5-a4e4-9e6231723af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:02.051033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100d092-f29c-423f-a10d-fccf6fbac326 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:02.051661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb5c2-cd51-4de5-a4e4-9e6231723af0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.052088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb5c2-cd51-4de5-a4e4-9e6231723af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.052516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb5c2-cd51-4de5-a4e4-9e6231723af0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.061245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7feb5c2-cd51-4de5-a4e4-9e6231723af0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:02.063768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7feb5c2-cd51-4de5-a4e4-9e6231723af0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e100d092-f29c-423f-a10d-fccf6fbac326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:02.064857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:02.065775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:02.066671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:02.066671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:02.066671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:02.066671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:02.066671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:02.066671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:02.066671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:02.066671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:02.066671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 338/676] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:02.067162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100d092-f29c-423f-a10d-fccf6fbac326 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a7feb5c2-cd51-4de5-a4e4-9e6231723af0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:02.080308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:02.081270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:02.082132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:02.082132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:02.082132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:02.082132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:02.082132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:02.082132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:02.082132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:02.082132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:02.084493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 339/677] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:02.090847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb5c2-cd51-4de5-a4e4-9e6231723af0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:02.151334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:02.198069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100d092-f29c-423f-a10d-fccf6fbac326 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:02.211628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb5c2-cd51-4de5-a4e4-9e6231723af0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:02.238204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:02.247303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed1377-7be0-473d-8cfe-2a13cc5b734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:02.248435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1377-7be0-473d-8cfe-2a13cc5b734f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.248925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1377-7be0-473d-8cfe-2a13cc5b734f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.249482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1377-7be0-473d-8cfe-2a13cc5b734f None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.250330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed1377-7be0-473d-8cfe-2a13cc5b734f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:02.250860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed1377-7be0-473d-8cfe-2a13cc5b734f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:02.251492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32d8a4-1906-4204-9066-516a5f3a8707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:02.252095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d8a4-1906-4204-9066-516a5f3a8707 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.252373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d8a4-1906-4204-9066-516a5f3a8707 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.252640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d8a4-1906-4204-9066-516a5f3a8707 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.253384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32d8a4-1906-4204-9066-516a5f3a8707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:02.253598 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed1377-7be0-473d-8cfe-2a13cc5b734f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:02.253698 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32d8a4-1906-4204-9066-516a5f3a8707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:02.255077 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32d8a4-1906-4204-9066-516a5f3a8707 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:02.268824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 339/678] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:02.269381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 340/679] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:02.270408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed1377-7be0-473d-8cfe-2a13cc5b734f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:02.274038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32d8a4-1906-4204-9066-516a5f3a8707 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:02.403117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32d8a4-1906-4204-9066-516a5f3a8707 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:02.425005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed1377-7be0-473d-8cfe-2a13cc5b734f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:02.439580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc826b6-7abf-4ca1-9252-7950cd2e69c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:02.440235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc826b6-7abf-4ca1-9252-7950cd2e69c6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.440512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc826b6-7abf-4ca1-9252-7950cd2e69c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.440788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc826b6-7abf-4ca1-9252-7950cd2e69c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.449398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc826b6-7abf-4ca1-9252-7950cd2e69c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:02.450877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc826b6-7abf-4ca1-9252-7950cd2e69c6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:02.463475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-4cc826b6-7abf-4ca1-9252-7950cd2e69c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:02.464487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:02.465482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:02.466494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 341/680] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:02.467094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc826b6-7abf-4ca1-9252-7950cd2e69c6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:02.475755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e182-0064-4089-833e-48333974d296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:02.476758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e182-0064-4089-833e-48333974d296 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.477851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e182-0064-4089-833e-48333974d296 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.478463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e182-0064-4089-833e-48333974d296 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.479496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e182-0064-4089-833e-48333974d296 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:02.480040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e182-0064-4089-833e-48333974d296 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:02.482008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e182-0064-4089-833e-48333974d296 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:02.501105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 340/681] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:02.502400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e182-0064-4089-833e-48333974d296 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:02.516486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:02.572752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc826b6-7abf-4ca1-9252-7950cd2e69c6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:02.607019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c50859-201c-45c5-bc05-1e2fbc3b93a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:02.607621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c50859-201c-45c5-bc05-1e2fbc3b93a6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.607897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c50859-201c-45c5-bc05-1e2fbc3b93a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.608166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c50859-201c-45c5-bc05-1e2fbc3b93a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.608889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c50859-201c-45c5-bc05-1e2fbc3b93a6 None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=ad0f25125b534983af66d5326f4d626d) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:02.609225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c50859-201c-45c5-bc05-1e2fbc3b93a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:02.610623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c50859-201c-45c5-bc05-1e2fbc3b93a6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:02.614788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e182-0064-4089-833e-48333974d296 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:02.616316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 342/682] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:02 2022] GET /identity/v3/role_assignments?user.id=ad0f25125b534983af66d5326f4d626d&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:02.622661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c50859-201c-45c5-bc05-1e2fbc3b93a6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:02.663941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3985cce-2e62-46bd-80ae-2645838c62c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:02.664902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985cce-2e62-46bd-80ae-2645838c62c6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.665384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985cce-2e62-46bd-80ae-2645838c62c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.665805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985cce-2e62-46bd-80ae-2645838c62c6 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.667001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3985cce-2e62-46bd-80ae-2645838c62c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:02.668474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3985cce-2e62-46bd-80ae-2645838c62c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:02.670261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3985cce-2e62-46bd-80ae-2645838c62c6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:02.698356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 341/683] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 10:20:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:02.700014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a40c-6828-4535-b115-d2df34b5946c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.700443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a40c-6828-4535-b115-d2df34b5946c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.700851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a40c-6828-4535-b115-d2df34b5946c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.706581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 342/684] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:02.706581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7a40c-6828-4535-b115-d2df34b5946c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:02.764485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:02.767089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c50859-201c-45c5-bc05-1e2fbc3b93a6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:02.782265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:02.821386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2e946-440f-4607-8203-127a3ce51a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:02.821386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e946-440f-4607-8203-127a3ce51a82 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.821682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e946-440f-4607-8203-127a3ce51a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.821757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e946-440f-4607-8203-127a3ce51a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.822480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2e946-440f-4607-8203-127a3ce51a82 None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=561dd954e4184662b33ca3356aa08d15) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:02.822796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2e946-440f-4607-8203-127a3ce51a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:02.824400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2e946-440f-4607-8203-127a3ce51a82 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:02.827686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7a40c-6828-4535-b115-d2df34b5946c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:02.834862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 343/685] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:02 2022] GET /identity/v3/role_assignments?user.id=561dd954e4184662b33ca3356aa08d15&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:02.836256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc03d-920d-4e80-a036-ea1fd972ae3a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.837939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc03d-920d-4e80-a036-ea1fd972ae3a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.838364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc03d-920d-4e80-a036-ea1fd972ae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.860162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2aefc03d-920d-4e80-a036-ea1fd972ae3a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:02.861905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2aefc03d-920d-4e80-a036-ea1fd972ae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:02.870596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cff11-1495-48cf-a49b-e0b84c12a88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:02.871382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cff11-1495-48cf-a49b-e0b84c12a88a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:02.871769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cff11-1495-48cf-a49b-e0b84c12a88a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:02.872178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cff11-1495-48cf-a49b-e0b84c12a88a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:02.943884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 344/686] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:20:02.958367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cff11-1495-48cf-a49b-e0b84c12a88a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:02.960180 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cff11-1495-48cf-a49b-e0b84c12a88a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:03.022139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:03.082661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 343/687] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:20:03.088434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefc03d-920d-4e80-a036-ea1fd972ae3a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:03.212074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefc03d-920d-4e80-a036-ea1fd972ae3a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:03.214009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:03.247803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5776289-2507-4091-8b96-b6ce5ae869d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:03.248435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776289-2507-4091-8b96-b6ce5ae869d7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:03.248712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776289-2507-4091-8b96-b6ce5ae869d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:03.249000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776289-2507-4091-8b96-b6ce5ae869d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:03.260052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5776289-2507-4091-8b96-b6ce5ae869d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:03.261518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5776289-2507-4091-8b96-b6ce5ae869d7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:03.272318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cff11-1495-48cf-a49b-e0b84c12a88a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b5776289-2507-4091-8b96-b6ce5ae869d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:03.294601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:03.295597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:03.296855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:03.296855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:03.296855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:03.296855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 345/688] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:03.302896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5776289-2507-4091-8b96-b6ce5ae869d7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:03.464799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cff11-1495-48cf-a49b-e0b84c12a88a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:03.490517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5776289-2507-4091-8b96-b6ce5ae869d7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:03.531116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb0b05-5c5e-4fcf-a574-302973fedf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:03.531746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0b05-5c5e-4fcf-a574-302973fedf54 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:03.532022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0b05-5c5e-4fcf-a574-302973fedf54 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:03.532289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0b05-5c5e-4fcf-a574-302973fedf54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:03.548219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb0b05-5c5e-4fcf-a574-302973fedf54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d5eb0b05-5c5e-4fcf-a574-302973fedf54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:03.553556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:03.554514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:03.555381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:03.558009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 344/689] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:03.558646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df0537-4cda-4809-b866-1d35e70749d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:03.559325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df0537-4cda-4809-b866-1d35e70749d1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:03.559612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df0537-4cda-4809-b866-1d35e70749d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:03.559882 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df0537-4cda-4809-b866-1d35e70749d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:03.560524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df0537-4cda-4809-b866-1d35e70749d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:03.560826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df0537-4cda-4809-b866-1d35e70749d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:03.562259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df0537-4cda-4809-b866-1d35e70749d1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:03.563452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb0b05-5c5e-4fcf-a574-302973fedf54 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:03.575198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:03.576816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 346/690] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:03.583096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df0537-4cda-4809-b866-1d35e70749d1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:03.617944 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:03.696479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb0b05-5c5e-4fcf-a574-302973fedf54 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:03.760671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b48ab9-8431-49ef-b878-9f0549648e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:03.761219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b48ab9-8431-49ef-b878-9f0549648e02 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:03.761554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b48ab9-8431-49ef-b878-9f0549648e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:03.761831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b48ab9-8431-49ef-b878-9f0549648e02 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:03.762496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b48ab9-8431-49ef-b878-9f0549648e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:03.762798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b48ab9-8431-49ef-b878-9f0549648e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:03.767437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b48ab9-8431-49ef-b878-9f0549648e02 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:03.782954 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 345/691] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:03.788262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b48ab9-8431-49ef-b878-9f0549648e02 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:03.790044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df0537-4cda-4809-b866-1d35e70749d1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:03.861324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7e89c-f15c-4386-b0a9-534d434ced0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:03.861962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7e89c-f15c-4386-b0a9-534d434ced0e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:03.862243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7e89c-f15c-4386-b0a9-534d434ced0e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:03.862513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7e89c-f15c-4386-b0a9-534d434ced0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:03.874595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7e89c-f15c-4386-b0a9-534d434ced0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:03.876039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7e89c-f15c-4386-b0a9-534d434ced0e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-75b7e89c-f15c-4386-b0a9-534d434ced0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:03.898274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:03.899348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:03.900218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:03.900218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:03.900218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:03.900218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:03.900218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:03.900218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:03.900218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:03.900218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:03.900629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 347/692] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:03.907962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7e89c-f15c-4386-b0a9-534d434ced0e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:03.917296 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:03.980037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b48ab9-8431-49ef-b878-9f0549648e02 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:04.060435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb3ace-e31e-41df-975a-f1b7ff4d3e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:04.061026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb3ace-e31e-41df-975a-f1b7ff4d3e16 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:04.061310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb3ace-e31e-41df-975a-f1b7ff4d3e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:04.061585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb3ace-e31e-41df-975a-f1b7ff4d3e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:04.073339 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:04.080815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb3ace-e31e-41df-975a-f1b7ff4d3e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:04.082324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb3ace-e31e-41df-975a-f1b7ff4d3e16 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:04.107859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7e89c-f15c-4386-b0a9-534d434ced0e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-cdfb3ace-e31e-41df-975a-f1b7ff4d3e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:04.108417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:04.109337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:04.110227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:04.110227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:04.110227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:04.110227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 346/693] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:04.118646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb3ace-e31e-41df-975a-f1b7ff4d3e16 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:04.149502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70da0c2-48b5-4e5f-a680-597625352778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:04.150126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70da0c2-48b5-4e5f-a680-597625352778 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:04.150410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70da0c2-48b5-4e5f-a680-597625352778 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:04.150685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70da0c2-48b5-4e5f-a680-597625352778 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:04.151636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70da0c2-48b5-4e5f-a680-597625352778 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:04.151949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70da0c2-48b5-4e5f-a680-597625352778 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:04.153419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70da0c2-48b5-4e5f-a680-597625352778 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:04.175080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 348/694] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:04.182158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70da0c2-48b5-4e5f-a680-597625352778 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:04.288782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb3ace-e31e-41df-975a-f1b7ff4d3e16 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:04.335807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:04.364313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70da0c2-48b5-4e5f-a680-597625352778 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:04.369445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb37b7-70e4-4f13-8cf8-e9aa9574cd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:04.370446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb37b7-70e4-4f13-8cf8-e9aa9574cd10 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:04.370446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb37b7-70e4-4f13-8cf8-e9aa9574cd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:04.370610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb37b7-70e4-4f13-8cf8-e9aa9574cd10 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:04.371235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb37b7-70e4-4f13-8cf8-e9aa9574cd10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:04.371537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb37b7-70e4-4f13-8cf8-e9aa9574cd10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:04.372913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb37b7-70e4-4f13-8cf8-e9aa9574cd10 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:04.388456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 347/695] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:04.389755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc70282-4526-42df-94c5-241ce5694652 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:04.390037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc70282-4526-42df-94c5-241ce5694652 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:04.390305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc70282-4526-42df-94c5-241ce5694652 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:04.391713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 348/696] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:04.397991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc70282-4526-42df-94c5-241ce5694652 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:04.402138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13055c7-f4f0-4b75-bb1a-d4271b2e0ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:04.402777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13055c7-f4f0-4b75-bb1a-d4271b2e0ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:04.403130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13055c7-f4f0-4b75-bb1a-d4271b2e0ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:04.403480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13055c7-f4f0-4b75-bb1a-d4271b2e0ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:04.404385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13055c7-f4f0-4b75-bb1a-d4271b2e0ec4 None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=e5b380b92dc5438c92380c3fe2406590) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:04.405582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13055c7-f4f0-4b75-bb1a-d4271b2e0ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:04.406431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13055c7-f4f0-4b75-bb1a-d4271b2e0ec4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:04.410315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:04.413980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 349/697] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:04 2022] GET /identity/v3/role_assignments?user.id=e5b380b92dc5438c92380c3fe2406590&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:04.417765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f0633-c8eb-4cab-b8ea-b1b026365b2f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:04.418004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f0633-c8eb-4cab-b8ea-b1b026365b2f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:04.418291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f0633-c8eb-4cab-b8ea-b1b026365b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:04.457664 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a09f0633-c8eb-4cab-b8ea-b1b026365b2f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:04.458941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a09f0633-c8eb-4cab-b8ea-b1b026365b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:04.547146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 350/698] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:20:04.584391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc70282-4526-42df-94c5-241ce5694652 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:04.621887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bf8a-875b-49a6-b94a-f10864dd8133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:04.622501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bf8a-875b-49a6-b94a-f10864dd8133 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:04.622788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bf8a-875b-49a6-b94a-f10864dd8133 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:04.623063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bf8a-875b-49a6-b94a-f10864dd8133 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:04.631414 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979bf8a-875b-49a6-b94a-f10864dd8133 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:04.632887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979bf8a-875b-49a6-b94a-f10864dd8133 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5979bf8a-875b-49a6-b94a-f10864dd8133 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:04.646176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:04.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:04.648061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 349/699] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 10:20:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:04.653183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f0633-c8eb-4cab-b8ea-b1b026365b2f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:04.756033 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f0633-c8eb-4cab-b8ea-b1b026365b2f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:04.791195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:04.802836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27c45d-6ee8-4c35-a3f8-b33c14f9a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:04.803451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27c45d-6ee8-4c35-a3f8-b33c14f9a466 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:04.803730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27c45d-6ee8-4c35-a3f8-b33c14f9a466 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:04.804050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27c45d-6ee8-4c35-a3f8-b33c14f9a466 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:04.804781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27c45d-6ee8-4c35-a3f8-b33c14f9a466 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:04.805183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27c45d-6ee8-4c35-a3f8-b33c14f9a466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:04.806592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27c45d-6ee8-4c35-a3f8-b33c14f9a466 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:04.825165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 351/700] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 10:20:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:04.830272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bf8a-875b-49a6-b94a-f10864dd8133 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:04.889358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:04.895630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27c45d-6ee8-4c35-a3f8-b33c14f9a466 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:04.951581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bf8a-875b-49a6-b94a-f10864dd8133 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:04.988558 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52777705-81cb-4ebf-abb1-3cfcfd81114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:04.989255 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52777705-81cb-4ebf-abb1-3cfcfd81114a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:04.989584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52777705-81cb-4ebf-abb1-3cfcfd81114a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:04.989872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52777705-81cb-4ebf-abb1-3cfcfd81114a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.009395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27c45d-6ee8-4c35-a3f8-b33c14f9a466 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:05.061667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4853f7-5fe1-4f3f-bcc2-e63c643c60b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:05.061908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52777705-81cb-4ebf-abb1-3cfcfd81114a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:05.062310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4853f7-5fe1-4f3f-bcc2-e63c643c60b4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:05.062586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4853f7-5fe1-4f3f-bcc2-e63c643c60b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:05.062863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4853f7-5fe1-4f3f-bcc2-e63c643c60b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.063301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52777705-81cb-4ebf-abb1-3cfcfd81114a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:05.089294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4853f7-5fe1-4f3f-bcc2-e63c643c60b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:05.090724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4853f7-5fe1-4f3f-bcc2-e63c643c60b4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6d4853f7-5fe1-4f3f-bcc2-e63c643c60b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:05.127862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:05.128850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:05.129823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:05.129823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:05.129823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:05.132605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 352/701] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:05.133374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:05.142023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4853f7-5fe1-4f3f-bcc2-e63c643c60b4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:05.182128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 350/702] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:20:05.188634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52777705-81cb-4ebf-abb1-3cfcfd81114a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:05.225679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:05.322959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4853f7-5fe1-4f3f-bcc2-e63c643c60b4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:05.327047 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52777705-81cb-4ebf-abb1-3cfcfd81114a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:05.361548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41815ebd-62bd-4a47-ba74-18285ac81d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:05.362507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41815ebd-62bd-4a47-ba74-18285ac81d66 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:05.363010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41815ebd-62bd-4a47-ba74-18285ac81d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:05.363493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41815ebd-62bd-4a47-ba74-18285ac81d66 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.364334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41815ebd-62bd-4a47-ba74-18285ac81d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:05.364835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41815ebd-62bd-4a47-ba74-18285ac81d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:05.366458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41815ebd-62bd-4a47-ba74-18285ac81d66 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:05.374408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672301a-319d-4247-b7f6-79dc72ced213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:05.374627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672301a-319d-4247-b7f6-79dc72ced213 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:05.374846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672301a-319d-4247-b7f6-79dc72ced213 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:05.375122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672301a-319d-4247-b7f6-79dc72ced213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.380822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 353/703] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:05.390079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41815ebd-62bd-4a47-ba74-18285ac81d66 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:05.396577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672301a-319d-4247-b7f6-79dc72ced213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:05.398075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672301a-319d-4247-b7f6-79dc72ced213 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:05.401979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0672301a-319d-4247-b7f6-79dc72ced213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:05.418648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:05.419663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:05.420527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:05.420527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:05.420527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:05.420527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 351/704] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:05.425501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50beb38f-dd01-40c1-8836-a6cf934bfc6a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:05.425789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50beb38f-dd01-40c1-8836-a6cf934bfc6a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:05.426193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50beb38f-dd01-40c1-8836-a6cf934bfc6a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.427500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 352/705] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:05.428304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50beb38f-dd01-40c1-8836-a6cf934bfc6a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:05.522656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:05.528602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41815ebd-62bd-4a47-ba74-18285ac81d66 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:05.546310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50beb38f-dd01-40c1-8836-a6cf934bfc6a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:05.566442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b26c59-dc5d-4434-918e-d2d9b8c7bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:05.567076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26c59-dc5d-4434-918e-d2d9b8c7bed3 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:05.567327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26c59-dc5d-4434-918e-d2d9b8c7bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:05.567597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26c59-dc5d-4434-918e-d2d9b8c7bed3 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.568230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b26c59-dc5d-4434-918e-d2d9b8c7bed3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:05.569681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b26c59-dc5d-4434-918e-d2d9b8c7bed3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:05.580480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af0fb5-084a-4724-b165-11c5a014a7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:05.581112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af0fb5-084a-4724-b165-11c5a014a7ef None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:05.581410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af0fb5-084a-4724-b165-11c5a014a7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:05.581686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af0fb5-084a-4724-b165-11c5a014a7ef None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.582346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af0fb5-084a-4724-b165-11c5a014a7ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:05.582629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af0fb5-084a-4724-b165-11c5a014a7ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:05.583974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af0fb5-084a-4724-b165-11c5a014a7ef None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:05.592994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 354/706] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:20:05 2022] POST /identity/v3/users => generated 254 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:05.594404 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3417-19d4-4859-a483-581849f82e1f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:05.594694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3417-19d4-4859-a483-581849f82e1f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:05.594996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3417-19d4-4859-a483-581849f82e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.606021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 353/707] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:05.607417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc008e-06a1-45a8-9b29-042c6b22f171 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:05.607781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc008e-06a1-45a8-9b29-042c6b22f171 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:05.608120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc008e-06a1-45a8-9b29-042c6b22f171 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.613660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 354/708] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:05.613660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc008e-06a1-45a8-9b29-042c6b22f171 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:05.689201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:05.740551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d7de3417-19d4-4859-a483-581849f82e1f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:05.743157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d7de3417-19d4-4859-a483-581849f82e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:05.746971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc008e-06a1-45a8-9b29-042c6b22f171 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:05.791280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738f368-2f5e-4743-b32e-c289f8e53cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:05.791926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738f368-2f5e-4743-b32e-c289f8e53cbb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:05.792209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738f368-2f5e-4743-b32e-c289f8e53cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:05.792482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738f368-2f5e-4743-b32e-c289f8e53cbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.800236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738f368-2f5e-4743-b32e-c289f8e53cbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:05.801734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738f368-2f5e-4743-b32e-c289f8e53cbb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8738f368-2f5e-4743-b32e-c289f8e53cbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:05.817979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:05.818949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:05.819821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:05.819821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:05.819821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:05.819821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:05.819821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:05.819821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:05.819821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:05.819821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:05.823170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 355/709] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:05.824887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612812f-ec5a-41b4-aa7f-b5100ad56a51 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:05.825432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612812f-ec5a-41b4-aa7f-b5100ad56a51 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:05.825878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612812f-ec5a-41b4-aa7f-b5100ad56a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:05.838417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 355/710] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:20:05.841729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3417-19d4-4859-a483-581849f82e1f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:05.854368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c612812f-ec5a-41b4-aa7f-b5100ad56a51 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:05.855878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c612812f-ec5a-41b4-aa7f-b5100ad56a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:05.953172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 356/711] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:20:05.964068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:05.985414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3417-19d4-4859-a483-581849f82e1f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:06.027196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1cc47-16fe-45ed-aade-e61312c6c982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:06.027811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1cc47-16fe-45ed-aade-e61312c6c982 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:06.028088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1cc47-16fe-45ed-aade-e61312c6c982 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:06.028407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1cc47-16fe-45ed-aade-e61312c6c982 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:06.029129 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1cc47-16fe-45ed-aade-e61312c6c982 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:06.029436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1cc47-16fe-45ed-aade-e61312c6c982 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:06.030858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1cc47-16fe-45ed-aade-e61312c6c982 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:06.044405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 356/712] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:06.050297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612812f-ec5a-41b4-aa7f-b5100ad56a51 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:06.097860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:06.143822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1cc47-16fe-45ed-aade-e61312c6c982 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:06.175459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612812f-ec5a-41b4-aa7f-b5100ad56a51 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:06.242346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5549-7d43-4bde-b492-8282d7e5b3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:06.242927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5549-7d43-4bde-b492-8282d7e5b3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:06.243244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5549-7d43-4bde-b492-8282d7e5b3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:06.243476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5549-7d43-4bde-b492-8282d7e5b3d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:06.244209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5549-7d43-4bde-b492-8282d7e5b3d6 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=e58300ef26a547028e837ba2da615991) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:06.244520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5549-7d43-4bde-b492-8282d7e5b3d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:06.245976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5549-7d43-4bde-b492-8282d7e5b3d6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:06.249646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1cc47-16fe-45ed-aade-e61312c6c982 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:06.259692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 357/713] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:06 2022] GET /identity/v3/role_assignments?user.id=e58300ef26a547028e837ba2da615991&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:06.266360 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5549-7d43-4bde-b492-8282d7e5b3d6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:06.287651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ac2e-291f-4327-902b-ec66a033d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:06.288303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ac2e-291f-4327-902b-ec66a033d823 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:06.288586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ac2e-291f-4327-902b-ec66a033d823 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:06.288859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ac2e-291f-4327-902b-ec66a033d823 None admin] PATH_INFO: `/v3/services/network` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:06.289525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ac2e-291f-4327-902b-ec66a033d823 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:06.290934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ac2e-291f-4327-902b-ec66a033d823 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f988ac2e-291f-4327-902b-ec66a033d823 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:06.302657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:06.303842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:06.304686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 357/714] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:06 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:06.310141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ac2e-291f-4327-902b-ec66a033d823 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:06.322980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:06.425039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ac2e-291f-4327-902b-ec66a033d823 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:06.483588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa5ab0-41fd-45d4-b3a8-3cdf2bf77c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:06.484204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa5ab0-41fd-45d4-b3a8-3cdf2bf77c70 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:06.484485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa5ab0-41fd-45d4-b3a8-3cdf2bf77c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:06.484757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa5ab0-41fd-45d4-b3a8-3cdf2bf77c70 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:06.485439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa5ab0-41fd-45d4-b3a8-3cdf2bf77c70 None admin] RBAC: Adding query filter params (name=network) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:06.485747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa5ab0-41fd-45d4-b3a8-3cdf2bf77c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:06.493175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa5ab0-41fd-45d4-b3a8-3cdf2bf77c70 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:06.493345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 358/715] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:06.498824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa5ab0-41fd-45d4-b3a8-3cdf2bf77c70 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:06.523590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5549-7d43-4bde-b492-8282d7e5b3d6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:06.536008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:06.581324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:06.587396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b794e-b3d6-49fd-a062-c4d21a1277ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:06.588042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b794e-b3d6-49fd-a062-c4d21a1277ca None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:06.588316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b794e-b3d6-49fd-a062-c4d21a1277ca None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:06.588582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b794e-b3d6-49fd-a062-c4d21a1277ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:06.589204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b794e-b3d6-49fd-a062-c4d21a1277ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:06.590564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b794e-b3d6-49fd-a062-c4d21a1277ca None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:06.614407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa5ab0-41fd-45d4-b3a8-3cdf2bf77c70 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f57b794e-b3d6-49fd-a062-c4d21a1277ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:06.621515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:06.622485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:06.623295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 358/716] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Sep 26 10:20:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:06.628597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b794e-b3d6-49fd-a062-c4d21a1277ca None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:06.654759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf0e25-3ee4-433d-af3d-94718da9455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:06.655887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0e25-3ee4-433d-af3d-94718da9455f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:06.656479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0e25-3ee4-433d-af3d-94718da9455f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:06.656991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0e25-3ee4-433d-af3d-94718da9455f None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:06.657846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf0e25-3ee4-433d-af3d-94718da9455f None admin] RBAC: Adding query filter params (type=network) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:06.658348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf0e25-3ee4-433d-af3d-94718da9455f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:06.659955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf0e25-3ee4-433d-af3d-94718da9455f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:06.667046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 359/717] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:06.781609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b794e-b3d6-49fd-a062-c4d21a1277ca None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:06.831625 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebf1e9-bb72-44a8-92de-15d7c72257d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:06.832617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf1e9-bb72-44a8-92de-15d7c72257d6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:06.833135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf1e9-bb72-44a8-92de-15d7c72257d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:06.833609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf1e9-bb72-44a8-92de-15d7c72257d6 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:06.834490 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebf1e9-bb72-44a8-92de-15d7c72257d6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:06.834994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebf1e9-bb72-44a8-92de-15d7c72257d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:06.836760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebf1e9-bb72-44a8-92de-15d7c72257d6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:06.842367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 359/718] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 10:20:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:06.849968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf0e25-3ee4-433d-af3d-94718da9455f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:06.967969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf0e25-3ee4-433d-af3d-94718da9455f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:07.007642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5978e-27c4-4a22-806e-ca0d66b194cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:07.009186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5978e-27c4-4a22-806e-ca0d66b194cc None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:07.009672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5978e-27c4-4a22-806e-ca0d66b194cc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:07.010165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5978e-27c4-4a22-806e-ca0d66b194cc None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:07.011089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5978e-27c4-4a22-806e-ca0d66b194cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:07.011594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5978e-27c4-4a22-806e-ca0d66b194cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:07.013171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5978e-27c4-4a22-806e-ca0d66b194cc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:07.016044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:07.019256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 360/719] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 10:20:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:07.305402 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3e7fe-3f27-4c7d-906f-52f2bce35912 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:07.305944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3e7fe-3f27-4c7d-906f-52f2bce35912 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:07.305944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3e7fe-3f27-4c7d-906f-52f2bce35912 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:07.307619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 360/720] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:07.313189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5dc4b-5592-4bdc-bd87-9bebdc3d7f90 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:07.313482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5dc4b-5592-4bdc-bd87-9bebdc3d7f90 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:07.313758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5dc4b-5592-4bdc-bd87-9bebdc3d7f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:07.335542 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-70a5dc4b-5592-4bdc-bd87-9bebdc3d7f90 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:07.337609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-70a5dc4b-5592-4bdc-bd87-9bebdc3d7f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:07.414876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 361/721] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:20:07.868718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3e7fe-3f27-4c7d-906f-52f2bce35912 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:07.914002 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:08.009523 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3e7fe-3f27-4c7d-906f-52f2bce35912 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:08.057070 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37657cdd-55d3-4080-ae4b-f2c741394795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:08.057711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37657cdd-55d3-4080-ae4b-f2c741394795 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:08.057990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37657cdd-55d3-4080-ae4b-f2c741394795 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:08.058264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37657cdd-55d3-4080-ae4b-f2c741394795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:08.068641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37657cdd-55d3-4080-ae4b-f2c741394795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-37657cdd-55d3-4080-ae4b-f2c741394795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:08.074027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:08.074985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:08.075812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 361/722] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:08.082724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5dc4b-5592-4bdc-bd87-9bebdc3d7f90 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:08.217108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5dc4b-5592-4bdc-bd87-9bebdc3d7f90 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:08.257304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:08.262686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a01639-10ca-4821-ad02-83a0f328e3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:08.263336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a01639-10ca-4821-ad02-83a0f328e3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:08.263643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a01639-10ca-4821-ad02-83a0f328e3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:08.263884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a01639-10ca-4821-ad02-83a0f328e3f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:08.264548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a01639-10ca-4821-ad02-83a0f328e3f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:08.269356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a01639-10ca-4821-ad02-83a0f328e3f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:08.270739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a01639-10ca-4821-ad02-83a0f328e3f6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:08.279692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 362/723] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:08.286110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37657cdd-55d3-4080-ae4b-f2c741394795 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:08.407716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423c601-c2a9-48ed-b57d-4f2e10c09174 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:08.407982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423c601-c2a9-48ed-b57d-4f2e10c09174 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:08.408345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423c601-c2a9-48ed-b57d-4f2e10c09174 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:08.409931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 363/724] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:08.416101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8786148-b5af-47c9-87b2-3bf97b0c56f5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:08.416382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8786148-b5af-47c9-87b2-3bf97b0c56f5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:08.416653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8786148-b5af-47c9-87b2-3bf97b0c56f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:08.442331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:08.449206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37657cdd-55d3-4080-ae4b-f2c741394795 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:08.454143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d8786148-b5af-47c9-87b2-3bf97b0c56f5 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:08.455583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d8786148-b5af-47c9-87b2-3bf97b0c56f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:08.494475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131665f-95f1-4170-b9e8-6686366d5950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:08.495034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131665f-95f1-4170-b9e8-6686366d5950 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:08.495324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131665f-95f1-4170-b9e8-6686366d5950 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:08.495584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131665f-95f1-4170-b9e8-6686366d5950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:08.519285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131665f-95f1-4170-b9e8-6686366d5950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:08.520756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131665f-95f1-4170-b9e8-6686366d5950 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9131665f-95f1-4170-b9e8-6686366d5950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:08.550116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:08.551134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:08.552034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:08.552034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:08.552034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:08.560903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 362/725] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:08.561825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131665f-95f1-4170-b9e8-6686366d5950 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:08.594234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 364/726] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 10:20:08.686876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131665f-95f1-4170-b9e8-6686366d5950 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:08.722760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c24e62-372b-458d-840a-f67435863f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:08.723412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24e62-372b-458d-840a-f67435863f44 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:08.723705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24e62-372b-458d-840a-f67435863f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:08.723977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24e62-372b-458d-840a-f67435863f44 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:08.724614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c24e62-372b-458d-840a-f67435863f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:08.724921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c24e62-372b-458d-840a-f67435863f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:08.726301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c24e62-372b-458d-840a-f67435863f44 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:08.738802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 363/727] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:08.744831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8786148-b5af-47c9-87b2-3bf97b0c56f5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:08.848682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8786148-b5af-47c9-87b2-3bf97b0c56f5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:08.873578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:08.885723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507a73d-7631-40e3-a5c2-151ca2c6b971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:08.886576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507a73d-7631-40e3-a5c2-151ca2c6b971 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:08.887064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507a73d-7631-40e3-a5c2-151ca2c6b971 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:08.887537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507a73d-7631-40e3-a5c2-151ca2c6b971 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:08.894828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507a73d-7631-40e3-a5c2-151ca2c6b971 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:08.896445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507a73d-7631-40e3-a5c2-151ca2c6b971 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f507a73d-7631-40e3-a5c2-151ca2c6b971 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:08.909370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:08.910295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:08.911216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:08.911216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:08.911216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:08.911216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:08.911216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:08.911216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:08.911216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:08.911216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:08.911216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:20:08.911216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:08.913273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 365/728] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:08.922036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c24e62-372b-458d-840a-f67435863f44 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:08.934260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:09.012838 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507a73d-7631-40e3-a5c2-151ca2c6b971 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:09.064773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c24e62-372b-458d-840a-f67435863f44 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:09.103704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba7c0c-fd1f-40b3-8618-736c28b7eeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:09.104317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba7c0c-fd1f-40b3-8618-736c28b7eeb3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.104598 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba7c0c-fd1f-40b3-8618-736c28b7eeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.104871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba7c0c-fd1f-40b3-8618-736c28b7eeb3 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.105637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba7c0c-fd1f-40b3-8618-736c28b7eeb3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:09.105948 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba7c0c-fd1f-40b3-8618-736c28b7eeb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:09.107389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba7c0c-fd1f-40b3-8618-736c28b7eeb3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:09.126690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 364/729] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 10:20:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:09.132501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba7c0c-fd1f-40b3-8618-736c28b7eeb3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:09.208505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507a73d-7631-40e3-a5c2-151ca2c6b971 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:09.231205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:09.248791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1c5b4-587c-44f4-88de-ff132e5f7676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:09.249449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1c5b4-587c-44f4-88de-ff132e5f7676 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.249730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1c5b4-587c-44f4-88de-ff132e5f7676 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.250001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1c5b4-587c-44f4-88de-ff132e5f7676 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.262638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1c5b4-587c-44f4-88de-ff132e5f7676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-aac1c5b4-587c-44f4-88de-ff132e5f7676 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:09.268600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:09.269515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:09.270346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 366/730] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:20:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:09.273636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212fa16-d2cc-4002-8861-31c51c70ee7a None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.273636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212fa16-d2cc-4002-8861-31c51c70ee7a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.273636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212fa16-d2cc-4002-8861-31c51c70ee7a None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.277274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 367/731] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:09.277504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba7c0c-fd1f-40b3-8618-736c28b7eeb3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:09.278086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212fa16-d2cc-4002-8861-31c51c70ee7a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:09.322539 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595de8d-6218-44f9-b492-c8757c9bb6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:09.323211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595de8d-6218-44f9-b492-c8757c9bb6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.323520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595de8d-6218-44f9-b492-c8757c9bb6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.324328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595de8d-6218-44f9-b492-c8757c9bb6e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.327585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:09.401826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212fa16-d2cc-4002-8861-31c51c70ee7a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:09.425132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595de8d-6218-44f9-b492-c8757c9bb6e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:09.426860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595de8d-6218-44f9-b492-c8757c9bb6e3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:09.441049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46eb5d-5af3-442d-a117-1dd7996684d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:09.441959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46eb5d-5af3-442d-a117-1dd7996684d9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.442442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46eb5d-5af3-442d-a117-1dd7996684d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.442948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46eb5d-5af3-442d-a117-1dd7996684d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.443806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46eb5d-5af3-442d-a117-1dd7996684d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:09.444362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46eb5d-5af3-442d-a117-1dd7996684d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:09.446525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46eb5d-5af3-442d-a117-1dd7996684d9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:09.455866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 368/732] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:20:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:09.457410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd8d3-b3a1-44bc-b7f5-cce436c91ca3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.457915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd8d3-b3a1-44bc-b7f5-cce436c91ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.458389 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd8d3-b3a1-44bc-b7f5-cce436c91ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.481555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-733dd8d3-b3a1-44bc-b7f5-cce436c91ca3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:09.484023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-733dd8d3-b3a1-44bc-b7f5-cce436c91ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:09.505925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:09.548430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 365/733] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 10:20:09.549655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595de8d-6218-44f9-b492-c8757c9bb6e3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:09.574406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 369/734] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:20:09.575550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd8d3-b3a1-44bc-b7f5-cce436c91ca3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:09.645340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:09.672764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595de8d-6218-44f9-b492-c8757c9bb6e3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:09.685199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd8d3-b3a1-44bc-b7f5-cce436c91ca3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:09.708292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7234ac-570f-4018-85c5-b4dadc1f197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:09.709110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7234ac-570f-4018-85c5-b4dadc1f197f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.709397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7234ac-570f-4018-85c5-b4dadc1f197f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.709674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7234ac-570f-4018-85c5-b4dadc1f197f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.719799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7234ac-570f-4018-85c5-b4dadc1f197f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:09.721167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da59a6-d63d-4bee-995c-699b5e0d3be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:09.721292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7234ac-570f-4018-85c5-b4dadc1f197f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:09.721792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da59a6-d63d-4bee-995c-699b5e0d3be6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.722068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da59a6-d63d-4bee-995c-699b5e0d3be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.722337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da59a6-d63d-4bee-995c-699b5e0d3be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.732805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da59a6-d63d-4bee-995c-699b5e0d3be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:09.734258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da59a6-d63d-4bee-995c-699b5e0d3be6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7c7234ac-570f-4018-85c5-b4dadc1f197f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:09.736535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:09.737561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:09.738450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:09.738450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:09.738450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:09.738450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 366/735] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:09.739456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019995e-16ca-4aa2-b627-1a7ef4915aaf None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.739456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019995e-16ca-4aa2-b627-1a7ef4915aaf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.739456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019995e-16ca-4aa2-b627-1a7ef4915aaf None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.740657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 367/736] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:09.741505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92da35f-9ea0-4527-8811-dbbe2e97a9e1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.741783 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92da35f-9ea0-4527-8811-dbbe2e97a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.742372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92da35f-9ea0-4527-8811-dbbe2e97a9e1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.743748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 368/737] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:09.744283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92da35f-9ea0-4527-8811-dbbe2e97a9e1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d3da59a6-d63d-4bee-995c-699b5e0d3be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:09.762292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:09.763274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:09.764173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:09.764173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:09.764173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:09.768011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 370/738] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:09.769231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707a4b2-eaa6-44c7-b768-91ee99f80324 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.769786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707a4b2-eaa6-44c7-b768-91ee99f80324 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.770064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707a4b2-eaa6-44c7-b768-91ee99f80324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.770682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:09.787807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a707a4b2-eaa6-44c7-b768-91ee99f80324 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:09.788985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a707a4b2-eaa6-44c7-b768-91ee99f80324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:09.864971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 371/739] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:20:09.864971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb24c8-5498-4d0a-8864-4e4b54275ece None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.864971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb24c8-5498-4d0a-8864-4e4b54275ece None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.864971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb24c8-5498-4d0a-8864-4e4b54275ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.869904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92da35f-9ea0-4527-8811-dbbe2e97a9e1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:09.883037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5bfb24c8-5498-4d0a-8864-4e4b54275ece None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:09.884233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5bfb24c8-5498-4d0a-8864-4e4b54275ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:09.895582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:09.905401 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a275f-8316-4a22-9818-44c366b77687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:09.906001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a275f-8316-4a22-9818-44c366b77687 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:09.906563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a275f-8316-4a22-9818-44c366b77687 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:09.906673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a275f-8316-4a22-9818-44c366b77687 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:09.907277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a275f-8316-4a22-9818-44c366b77687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:09.907581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a275f-8316-4a22-9818-44c366b77687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:09.908964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a275f-8316-4a22-9818-44c366b77687 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:09.924998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 369/740] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:09.924998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a275f-8316-4a22-9818-44c366b77687 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:09.959850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 372/741] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 10:20:09.961099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb24c8-5498-4d0a-8864-4e4b54275ece None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.009554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:10.038006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a275f-8316-4a22-9818-44c366b77687 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.079936 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb24c8-5498-4d0a-8864-4e4b54275ece None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.084161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d7192-6247-499d-8ec5-926ccdf5623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.085084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d7192-6247-499d-8ec5-926ccdf5623b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:10.085586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d7192-6247-499d-8ec5-926ccdf5623b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:10.086082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d7192-6247-499d-8ec5-926ccdf5623b None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:10.087462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d7192-6247-499d-8ec5-926ccdf5623b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:10.088459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d7192-6247-499d-8ec5-926ccdf5623b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:10.090493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d7192-6247-499d-8ec5-926ccdf5623b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:10.110794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 370/742] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:10.112605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d7192-6247-499d-8ec5-926ccdf5623b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.120797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257e5f5-5d8a-415d-9770-fd7a2a393ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.121412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e5f5-5d8a-415d-9770-fd7a2a393ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:10.121690 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e5f5-5d8a-415d-9770-fd7a2a393ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:10.121964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e5f5-5d8a-415d-9770-fd7a2a393ff9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:10.134581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257e5f5-5d8a-415d-9770-fd7a2a393ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6257e5f5-5d8a-415d-9770-fd7a2a393ff9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:10.139573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:10.140467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:10.141334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:10.142586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 373/743] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:10.143385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257e5f5-5d8a-415d-9770-fd7a2a393ff9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.154195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:10.225524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d7192-6247-499d-8ec5-926ccdf5623b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.249281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257e5f5-5d8a-415d-9770-fd7a2a393ff9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.258872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea729-6747-4772-b382-fce4f83b470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.259496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea729-6747-4772-b382-fce4f83b470d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:10.259775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea729-6747-4772-b382-fce4f83b470d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:10.260043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea729-6747-4772-b382-fce4f83b470d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:10.267264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea729-6747-4772-b382-fce4f83b470d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:10.269059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea729-6747-4772-b382-fce4f83b470d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:10.270577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-899ea729-6747-4772-b382-fce4f83b470d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:10.281027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:10.281965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:10.282918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:10.282918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:10.282918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:10.282918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:10.282918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:10.282918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:10.282918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:10.282918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:10.282918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:10.282918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:10.283701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c427-fbe6-4b44-9838-b18814a4db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.283701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c427-fbe6-4b44-9838-b18814a4db1e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:10.283701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c427-fbe6-4b44-9838-b18814a4db1e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:10.283912 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c427-fbe6-4b44-9838-b18814a4db1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:10.287050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 371/744] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 10:20:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:10.287713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea729-6747-4772-b382-fce4f83b470d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.293201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338c427-fbe6-4b44-9838-b18814a4db1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:10.294622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338c427-fbe6-4b44-9838-b18814a4db1e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1338c427-fbe6-4b44-9838-b18814a4db1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:10.306760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:10.307692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:10.308667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:10.308667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:10.308667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:10.308667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:10.308667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:10.308667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:10.308667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:10.308667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:10.308667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 374/745] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:10.308667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c427-fbe6-4b44-9838-b18814a4db1e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.380989 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:10.389865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea729-6747-4772-b382-fce4f83b470d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.416742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c427-fbe6-4b44-9838-b18814a4db1e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.421977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51afbd-83d9-4048-b0ea-5930b359eed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.422577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51afbd-83d9-4048-b0ea-5930b359eed7 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:10.422855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51afbd-83d9-4048-b0ea-5930b359eed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:10.423125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51afbd-83d9-4048-b0ea-5930b359eed7 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:10.423770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51afbd-83d9-4048-b0ea-5930b359eed7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:10.425162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51afbd-83d9-4048-b0ea-5930b359eed7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:10.440643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 372/746] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:20:10 2022] POST /identity/v3/services => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:10.441458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51afbd-83d9-4048-b0ea-5930b359eed7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.465126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e4675-ecd6-473c-8ad1-9c897941d8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.465951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e4675-ecd6-473c-8ad1-9c897941d8df None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:10.466233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e4675-ecd6-473c-8ad1-9c897941d8df None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:10.466527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e4675-ecd6-473c-8ad1-9c897941d8df None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:10.467604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e4675-ecd6-473c-8ad1-9c897941d8df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:10.467926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e4675-ecd6-473c-8ad1-9c897941d8df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:10.469428 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e4675-ecd6-473c-8ad1-9c897941d8df None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:10.484682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 375/747] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:20:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:10.484682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e4675-ecd6-473c-8ad1-9c897941d8df None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.518726 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:10.572712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51afbd-83d9-4048-b0ea-5930b359eed7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.593957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e4675-ecd6-473c-8ad1-9c897941d8df None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.610347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc17f1-8022-4786-818b-0808210e8094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.611517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc17f1-8022-4786-818b-0808210e8094 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:10.611517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc17f1-8022-4786-818b-0808210e8094 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:10.611517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc17f1-8022-4786-818b-0808210e8094 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:10.612189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc17f1-8022-4786-818b-0808210e8094 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:10.613778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc17f1-8022-4786-818b-0808210e8094 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:10.621545 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:10.629531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 373/748] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:20:10 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:10.630518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc17f1-8022-4786-818b-0808210e8094 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.647496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3bb56-c4c2-4a7a-b085-023060dc9028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.648096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3bb56-c4c2-4a7a-b085-023060dc9028 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:10.648320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3bb56-c4c2-4a7a-b085-023060dc9028 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:10.648635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3bb56-c4c2-4a7a-b085-023060dc9028 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:10.650001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3bb56-c4c2-4a7a-b085-023060dc9028 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:10.650664 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3bb56-c4c2-4a7a-b085-023060dc9028 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:10.652076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3bb56-c4c2-4a7a-b085-023060dc9028 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:10.673595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 376/749] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 10:20:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:10.674603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3bb56-c4c2-4a7a-b085-023060dc9028 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.781363 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc17f1-8022-4786-818b-0808210e8094 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.797607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3bb56-c4c2-4a7a-b085-023060dc9028 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.803610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:10.821518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8ef5-d716-44b1-9fa0-6480294ac950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.822131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8ef5-d716-44b1-9fa0-6480294ac950 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:10.822409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8ef5-d716-44b1-9fa0-6480294ac950 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:10.822681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8ef5-d716-44b1-9fa0-6480294ac950 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:10.823387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8ef5-d716-44b1-9fa0-6480294ac950 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:10.823957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8ef5-d716-44b1-9fa0-6480294ac950 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:10.825528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8ef5-d716-44b1-9fa0-6480294ac950 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:10.836929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eaf1b1-b3f0-415e-a228-428a67533117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.837613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaf1b1-b3f0-415e-a228-428a67533117 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:10.837897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaf1b1-b3f0-415e-a228-428a67533117 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:10.838173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaf1b1-b3f0-415e-a228-428a67533117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:10.838815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 374/750] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:10.839656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8ef5-d716-44b1-9fa0-6480294ac950 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.849542 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eaf1b1-b3f0-415e-a228-428a67533117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:10.850990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eaf1b1-b3f0-415e-a228-428a67533117 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-83eaf1b1-b3f0-415e-a228-428a67533117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:10.866760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:10.868280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:10.869640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:10.869640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:10.869640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:10.869640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 377/751] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:10.869640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eaf1b1-b3f0-415e-a228-428a67533117 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:10.917883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:10.949697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8ef5-d716-44b1-9fa0-6480294ac950 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.998924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0526d4-429a-4606-a409-b5f532a61535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:10.999435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eaf1b1-b3f0-415e-a228-428a67533117 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:10.999706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0526d4-429a-4606-a409-b5f532a61535 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:11.000058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0526d4-429a-4606-a409-b5f532a61535 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:11.000399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0526d4-429a-4606-a409-b5f532a61535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:11.035393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7afbd-09ed-49d5-a407-8504a8f1442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:11.036245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7afbd-09ed-49d5-a407-8504a8f1442c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:11.036673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7afbd-09ed-49d5-a407-8504a8f1442c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:11.037147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7afbd-09ed-49d5-a407-8504a8f1442c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:11.038058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7afbd-09ed-49d5-a407-8504a8f1442c None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=e5b380b92dc5438c92380c3fe2406590) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:11.038560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7afbd-09ed-49d5-a407-8504a8f1442c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:11.040759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7afbd-09ed-49d5-a407-8504a8f1442c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:11.046973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 378/752] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:10 2022] GET /identity/v3/role_assignments?user.id=e5b380b92dc5438c92380c3fe2406590&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:11.048212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7afbd-09ed-49d5-a407-8504a8f1442c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:11.060566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:11.090877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0526d4-429a-4606-a409-b5f532a61535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:11.092678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0526d4-429a-4606-a409-b5f532a61535 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:11.171832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7afbd-09ed-49d5-a407-8504a8f1442c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:11.181356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:11.213832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcac7b6-5f2e-43c0-b6b4-f5a401cdeb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:11.214755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcac7b6-5f2e-43c0-b6b4-f5a401cdeb45 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:11.215046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcac7b6-5f2e-43c0-b6b4-f5a401cdeb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:11.215370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcac7b6-5f2e-43c0-b6b4-f5a401cdeb45 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:11.216037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcac7b6-5f2e-43c0-b6b4-f5a401cdeb45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:11.216350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcac7b6-5f2e-43c0-b6b4-f5a401cdeb45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:11.218042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcac7b6-5f2e-43c0-b6b4-f5a401cdeb45 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:11.233159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 379/753] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:11.242013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcac7b6-5f2e-43c0-b6b4-f5a401cdeb45 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:11.343124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 375/754] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:20:11.348714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0526d4-429a-4606-a409-b5f532a61535 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:11.386253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcac7b6-5f2e-43c0-b6b4-f5a401cdeb45 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:11.435062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f61a1-e52e-4b8d-bfbe-33e5b6f6ab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:11.436050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f61a1-e52e-4b8d-bfbe-33e5b6f6ab59 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:11.436334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f61a1-e52e-4b8d-bfbe-33e5b6f6ab59 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:11.436606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f61a1-e52e-4b8d-bfbe-33e5b6f6ab59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:11.455512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f61a1-e52e-4b8d-bfbe-33e5b6f6ab59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:11.456983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f61a1-e52e-4b8d-bfbe-33e5b6f6ab59 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1b7f61a1-e52e-4b8d-bfbe-33e5b6f6ab59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:11.480176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:11.481216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:11.482560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 380/755] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 10:20:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:11.489986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f61a1-e52e-4b8d-bfbe-33e5b6f6ab59 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:11.515357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:11.522803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:11.547112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0526d4-429a-4606-a409-b5f532a61535 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:11.583552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e27bf-a814-4cd9-8420-adf0a513a763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:11.584188 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e27bf-a814-4cd9-8420-adf0a513a763 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:11.584466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e27bf-a814-4cd9-8420-adf0a513a763 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:11.584798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e27bf-a814-4cd9-8420-adf0a513a763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:11.596268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e27bf-a814-4cd9-8420-adf0a513a763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:11.597734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e27bf-a814-4cd9-8420-adf0a513a763 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-140e27bf-a814-4cd9-8420-adf0a513a763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:11.613611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:11.615971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:11.618184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:11.618184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:11.618184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:11.618184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 376/756] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:11.620782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e27bf-a814-4cd9-8420-adf0a513a763 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:11.746277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e27bf-a814-4cd9-8420-adf0a513a763 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:11.747051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f61a1-e52e-4b8d-bfbe-33e5b6f6ab59 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:11.791340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:11.805468 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e901b-c616-4d94-b48f-dc11ce1176ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:11.806081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e901b-c616-4d94-b48f-dc11ce1176ed None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:11.806355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e901b-c616-4d94-b48f-dc11ce1176ed None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:11.806626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e901b-c616-4d94-b48f-dc11ce1176ed None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:11.807265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e901b-c616-4d94-b48f-dc11ce1176ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:11.807565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e901b-c616-4d94-b48f-dc11ce1176ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:11.808932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e901b-c616-4d94-b48f-dc11ce1176ed None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:11.812730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb963616-831a-4938-87a2-a20d2f5f2c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:11.813354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963616-831a-4938-87a2-a20d2f5f2c85 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:11.813627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963616-831a-4938-87a2-a20d2f5f2c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:11.813892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963616-831a-4938-87a2-a20d2f5f2c85 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:11.814615 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb963616-831a-4938-87a2-a20d2f5f2c85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:11.814918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb963616-831a-4938-87a2-a20d2f5f2c85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:11.816320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb963616-831a-4938-87a2-a20d2f5f2c85 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:11.840051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 377/757] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:11.841350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e901b-c616-4d94-b48f-dc11ce1176ed None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:11.855155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 381/758] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 10:20:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:11.856104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb963616-831a-4938-87a2-a20d2f5f2c85 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:11.978782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:12.005286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e901b-c616-4d94-b48f-dc11ce1176ed None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:12.036202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb963616-831a-4938-87a2-a20d2f5f2c85 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:12.063743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb2b9c-c3e5-4320-be27-3595eca37671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:12.064374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2b9c-c3e5-4320-be27-3595eca37671 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:12.064655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2b9c-c3e5-4320-be27-3595eca37671 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:12.064927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2b9c-c3e5-4320-be27-3595eca37671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:12.072201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb2b9c-c3e5-4320-be27-3595eca37671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:12.073676 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb2b9c-c3e5-4320-be27-3595eca37671 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-cdcb2b9c-c3e5-4320-be27-3595eca37671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:12.087053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:12.087944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:12.089387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:12.089387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:12.089387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:12.089387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:12.089387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:12.089387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:12.089387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:12.089387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:12.089387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 378/759] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:12.093954 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb2b9c-c3e5-4320-be27-3595eca37671 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:12.119022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2655176-3ae7-41cf-83db-7d55bd723c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:12.119990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2655176-3ae7-41cf-83db-7d55bd723c6e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:12.120476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2655176-3ae7-41cf-83db-7d55bd723c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:12.121006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2655176-3ae7-41cf-83db-7d55bd723c6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:12.146656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2655176-3ae7-41cf-83db-7d55bd723c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:12.148095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2655176-3ae7-41cf-83db-7d55bd723c6e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:12.152879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c2655176-3ae7-41cf-83db-7d55bd723c6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:12.172966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:12.173957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:12.174863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:12.174863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:12.174863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:12.175603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 382/760] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:12.181362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2655176-3ae7-41cf-83db-7d55bd723c6e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:12.245672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb2b9c-c3e5-4320-be27-3595eca37671 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:12.297060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e097ca-9e33-4d23-883a-ba59a833f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:12.297782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e097ca-9e33-4d23-883a-ba59a833f4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:12.298114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e097ca-9e33-4d23-883a-ba59a833f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:12.298634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e097ca-9e33-4d23-883a-ba59a833f4f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:12.299330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e097ca-9e33-4d23-883a-ba59a833f4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:12.299636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e097ca-9e33-4d23-883a-ba59a833f4f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:12.301078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e097ca-9e33-4d23-883a-ba59a833f4f9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:12.315415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 379/761] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:12.321098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e097ca-9e33-4d23-883a-ba59a833f4f9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:12.376086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2655176-3ae7-41cf-83db-7d55bd723c6e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:12.402193 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:12.413993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de90a71-65fd-4f64-8656-6cb53c371ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:12.414645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de90a71-65fd-4f64-8656-6cb53c371ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:12.414926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de90a71-65fd-4f64-8656-6cb53c371ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:12.415198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de90a71-65fd-4f64-8656-6cb53c371ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:12.415839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de90a71-65fd-4f64-8656-6cb53c371ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:12.416141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de90a71-65fd-4f64-8656-6cb53c371ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:12.417537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de90a71-65fd-4f64-8656-6cb53c371ae4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:12.430890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 383/762] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:12.438034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de90a71-65fd-4f64-8656-6cb53c371ae4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:12.502214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e097ca-9e33-4d23-883a-ba59a833f4f9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:12.522682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:12.538135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4a0b-7698-4101-b4d8-a0cbdc2ac516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:12.538744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4a0b-7698-4101-b4d8-a0cbdc2ac516 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:12.539024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4a0b-7698-4101-b4d8-a0cbdc2ac516 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:12.539297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4a0b-7698-4101-b4d8-a0cbdc2ac516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:12.540082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f4a0b-7698-4101-b4d8-a0cbdc2ac516 None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=ecdfe8d98368455db8b67097051b9e1c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:12.540397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f4a0b-7698-4101-b4d8-a0cbdc2ac516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:12.541860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f4a0b-7698-4101-b4d8-a0cbdc2ac516 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:12.548174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 380/763] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:12 2022] GET /identity/v3/role_assignments?user.id=ecdfe8d98368455db8b67097051b9e1c&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:12.612328 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de90a71-65fd-4f64-8656-6cb53c371ae4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:12.666060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97539614-152c-4d67-9a9b-31dbb2b55599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:12.666726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97539614-152c-4d67-9a9b-31dbb2b55599 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:12.667007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97539614-152c-4d67-9a9b-31dbb2b55599 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:12.667281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97539614-152c-4d67-9a9b-31dbb2b55599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:12.679015 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97539614-152c-4d67-9a9b-31dbb2b55599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:12.681121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97539614-152c-4d67-9a9b-31dbb2b55599 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-97539614-152c-4d67-9a9b-31dbb2b55599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:12.697454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:12.699653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:12.701898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:12.701898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:12.701898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:12.701898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:12.701898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:12.701898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:12.701898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:12.701898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:12.701898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 384/764] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:12.705040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4a0b-7698-4101-b4d8-a0cbdc2ac516 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:12.818126 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4a0b-7698-4101-b4d8-a0cbdc2ac516 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:12.856923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22bb53-5a9b-465b-b8e2-0abc956e4da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:12.857618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22bb53-5a9b-465b-b8e2-0abc956e4da4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:12.857905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22bb53-5a9b-465b-b8e2-0abc956e4da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:12.858179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22bb53-5a9b-465b-b8e2-0abc956e4da4 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:12.858869 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22bb53-5a9b-465b-b8e2-0abc956e4da4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:12.859175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22bb53-5a9b-465b-b8e2-0abc956e4da4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:12.860602 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22bb53-5a9b-465b-b8e2-0abc956e4da4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:12.873703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 381/765] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:12.879747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97539614-152c-4d67-9a9b-31dbb2b55599 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:12.933457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:12.998948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97539614-152c-4d67-9a9b-31dbb2b55599 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:13.002502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92496ad9-65bc-4b51-bda9-e87a1da5b231 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:13.002787 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92496ad9-65bc-4b51-bda9-e87a1da5b231 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:13.003061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92496ad9-65bc-4b51-bda9-e87a1da5b231 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:13.004377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 382/766] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:20:13.014934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c108c-6d37-4482-bada-0931895c52ed None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:13.015199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c108c-6d37-4482-bada-0931895c52ed None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:13.015445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c108c-6d37-4482-bada-0931895c52ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:13.054013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f43c108c-6d37-4482-bada-0931895c52ed None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:13.058659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f43c108c-6d37-4482-bada-0931895c52ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:13.077740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76749f-4abc-45ed-a656-8601f3aaa897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:13.078522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76749f-4abc-45ed-a656-8601f3aaa897 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:13.078880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76749f-4abc-45ed-a656-8601f3aaa897 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:13.079623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76749f-4abc-45ed-a656-8601f3aaa897 None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/e58300ef26a547028e837ba2da615991/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:13.087042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76749f-4abc-45ed-a656-8601f3aaa897 None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=e58300ef26a547028e837ba2da615991, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:13.088621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76749f-4abc-45ed-a656-8601f3aaa897 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:13.100624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:13.127410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 385/767] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:20:12 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/e58300ef26a547028e837ba2da615991/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:20:13.148074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 383/768] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:13.196213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405cab4-9408-481c-a57b-1c978c37a5b6 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:13.196620 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405cab4-9408-481c-a57b-1c978c37a5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:13.196990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405cab4-9408-481c-a57b-1c978c37a5b6 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:13.198801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 386/769] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:13.204585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fd7f8-0792-4328-9f7b-f9d28d65bc9d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:13.204877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fd7f8-0792-4328-9f7b-f9d28d65bc9d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:13.205199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fd7f8-0792-4328-9f7b-f9d28d65bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:13.230389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-092fd7f8-0792-4328-9f7b-f9d28d65bc9d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:13.231595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-092fd7f8-0792-4328-9f7b-f9d28d65bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:13.331587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 384/770] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:13.480215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405cab4-9408-481c-a57b-1c978c37a5b6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:13.606167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405cab4-9408-481c-a57b-1c978c37a5b6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:13.609277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:13.643082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ea25e-06d6-4fb2-8d0e-2f13eeb6e61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:13.643712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ea25e-06d6-4fb2-8d0e-2f13eeb6e61f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:13.643996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ea25e-06d6-4fb2-8d0e-2f13eeb6e61f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:13.644270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ea25e-06d6-4fb2-8d0e-2f13eeb6e61f None admin] PATH_INFO: `/v3/services/network` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:13.644854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ea25e-06d6-4fb2-8d0e-2f13eeb6e61f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:13.646227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ea25e-06d6-4fb2-8d0e-2f13eeb6e61f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-479ea25e-06d6-4fb2-8d0e-2f13eeb6e61f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:13.655924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:13.656920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:13.657858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 387/771] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:13 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:13.665047 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fd7f8-0792-4328-9f7b-f9d28d65bc9d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:13.695478 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2958944-1268-4012-9a69-5bfa52af4cde None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:13.696330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2958944-1268-4012-9a69-5bfa52af4cde None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:13.696564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2958944-1268-4012-9a69-5bfa52af4cde None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:13.698273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 388/772] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:13.703634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5dc0b-e99b-404c-9dc3-4e2837dc666e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:13.703917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5dc0b-e99b-404c-9dc3-4e2837dc666e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:13.704189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5dc0b-e99b-404c-9dc3-4e2837dc666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:13.723187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d2b5dc0b-e99b-404c-9dc3-4e2837dc666e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:13.724356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d2b5dc0b-e99b-404c-9dc3-4e2837dc666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:13.794386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:13.801540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 389/773] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:20:13.802286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fd7f8-0792-4328-9f7b-f9d28d65bc9d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:13.802400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5dc0b-e99b-404c-9dc3-4e2837dc666e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:13.839496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32c0e2-8a32-4314-8a93-bfb55e131c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:13.840340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32c0e2-8a32-4314-8a93-bfb55e131c1e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:13.840725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32c0e2-8a32-4314-8a93-bfb55e131c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:13.841129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32c0e2-8a32-4314-8a93-bfb55e131c1e None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:13.841914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32c0e2-8a32-4314-8a93-bfb55e131c1e None admin] RBAC: Adding query filter params (name=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:13.842314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32c0e2-8a32-4314-8a93-bfb55e131c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:13.843831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32c0e2-8a32-4314-8a93-bfb55e131c1e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:13.849024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 385/774] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:13.854297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32c0e2-8a32-4314-8a93-bfb55e131c1e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:13.965899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:13.971911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5dc0b-e99b-404c-9dc3-4e2837dc666e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.012622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155cb16-b15e-425b-aaf4-83161ccbc123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.013346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155cb16-b15e-425b-aaf4-83161ccbc123 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.013627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155cb16-b15e-425b-aaf4-83161ccbc123 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.013901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155cb16-b15e-425b-aaf4-83161ccbc123 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.014775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155cb16-b15e-425b-aaf4-83161ccbc123 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:14.016926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155cb16-b15e-425b-aaf4-83161ccbc123 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-0155cb16-b15e-425b-aaf4-83161ccbc123 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:14.028123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:14.029171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:14.029991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 390/775] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Sep 26 10:20:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:14.036976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155cb16-b15e-425b-aaf4-83161ccbc123 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:14.043766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32c0e2-8a32-4314-8a93-bfb55e131c1e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.113303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7637d-e38c-4d57-875c-e3f6d63fadde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.113919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7637d-e38c-4d57-875c-e3f6d63fadde None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.114200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7637d-e38c-4d57-875c-e3f6d63fadde None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.114473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7637d-e38c-4d57-875c-e3f6d63fadde None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.115112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7637d-e38c-4d57-875c-e3f6d63fadde None admin] RBAC: Adding query filter params (type=network) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:14.115416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7637d-e38c-4d57-875c-e3f6d63fadde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:14.116776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7637d-e38c-4d57-875c-e3f6d63fadde None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:14.128719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 386/776] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:14.135026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7637d-e38c-4d57-875c-e3f6d63fadde None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:14.186071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155cb16-b15e-425b-aaf4-83161ccbc123 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.189539 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:14.228285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb493cc8-99f9-4c20-b0f0-4d836f26628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.229111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb493cc8-99f9-4c20-b0f0-4d836f26628e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.229111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb493cc8-99f9-4c20-b0f0-4d836f26628e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.229387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb493cc8-99f9-4c20-b0f0-4d836f26628e None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.230004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb493cc8-99f9-4c20-b0f0-4d836f26628e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:14.230361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb493cc8-99f9-4c20-b0f0-4d836f26628e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:14.231772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb493cc8-99f9-4c20-b0f0-4d836f26628e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:14.237806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 391/777] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 10:20:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:14.238752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb493cc8-99f9-4c20-b0f0-4d836f26628e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:14.273188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:14.287677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7637d-e38c-4d57-875c-e3f6d63fadde None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.325620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67ac53-c807-4850-9ad6-c5789653687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.326243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67ac53-c807-4850-9ad6-c5789653687a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.326529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67ac53-c807-4850-9ad6-c5789653687a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.326806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67ac53-c807-4850-9ad6-c5789653687a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.327502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67ac53-c807-4850-9ad6-c5789653687a None admin] RBAC: Adding query filter params (interface=public, service_id=a8110f8ed32846b688ebfcbb23cfc4e4, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:14.327811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67ac53-c807-4850-9ad6-c5789653687a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:14.329202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67ac53-c807-4850-9ad6-c5789653687a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:14.341077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 387/778] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 10:20:14 2022] GET /identity/v3/endpoints?service_id=a8110f8ed32846b688ebfcbb23cfc4e4&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:14.342410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67ac53-c807-4850-9ad6-c5789653687a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:14.363277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb493cc8-99f9-4c20-b0f0-4d836f26628e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.411164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263af57-fc27-45f4-9957-abf465565f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.412124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263af57-fc27-45f4-9957-abf465565f81 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.412639 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263af57-fc27-45f4-9957-abf465565f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.413864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263af57-fc27-45f4-9957-abf465565f81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.426319 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263af57-fc27-45f4-9957-abf465565f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-e263af57-fc27-45f4-9957-abf465565f81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:14.433642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:14.434624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:14.435450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:14.443121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 392/779] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:14.444534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263af57-fc27-45f4-9957-abf465565f81 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:14.453107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:14.475608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67ac53-c807-4850-9ad6-c5789653687a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.524820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d85e0a-d2e8-40a0-a953-e78743f6cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.525384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d85e0a-d2e8-40a0-a953-e78743f6cae6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.525665 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d85e0a-d2e8-40a0-a953-e78743f6cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.525936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d85e0a-d2e8-40a0-a953-e78743f6cae6 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.526890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d85e0a-d2e8-40a0-a953-e78743f6cae6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:14.527194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d85e0a-d2e8-40a0-a953-e78743f6cae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:14.528738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d85e0a-d2e8-40a0-a953-e78743f6cae6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:14.535997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 388/780] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 10:20:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:14.536923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d85e0a-d2e8-40a0-a953-e78743f6cae6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:14.550737 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:14.569819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263af57-fc27-45f4-9957-abf465565f81 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.610612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd123dbf-7fef-419f-b697-e1dbcf10eb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.611390 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123dbf-7fef-419f-b697-e1dbcf10eb7d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.611776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123dbf-7fef-419f-b697-e1dbcf10eb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.612159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123dbf-7fef-419f-b697-e1dbcf10eb7d None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.612860 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd123dbf-7fef-419f-b697-e1dbcf10eb7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:14.614340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd123dbf-7fef-419f-b697-e1dbcf10eb7d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:14.621727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 393/781] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 10:20:14 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:14.622549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd123dbf-7fef-419f-b697-e1dbcf10eb7d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:14.662723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d85e0a-d2e8-40a0-a953-e78743f6cae6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.702166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746bc0a-8bbf-4328-93d2-3d74855b2b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.703503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746bc0a-8bbf-4328-93d2-3d74855b2b97 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.704028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746bc0a-8bbf-4328-93d2-3d74855b2b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.704505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746bc0a-8bbf-4328-93d2-3d74855b2b97 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.705390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746bc0a-8bbf-4328-93d2-3d74855b2b97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:14.705930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746bc0a-8bbf-4328-93d2-3d74855b2b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:14.707755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746bc0a-8bbf-4328-93d2-3d74855b2b97 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:14.718473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 389/782] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:20:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:14.724648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746bc0a-8bbf-4328-93d2-3d74855b2b97 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:14.742186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd123dbf-7fef-419f-b697-e1dbcf10eb7d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.743531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:14.782337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0613bc-f1bb-4951-8df3-46a008c6424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.782877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0613bc-f1bb-4951-8df3-46a008c6424b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.783161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0613bc-f1bb-4951-8df3-46a008c6424b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.783428 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0613bc-f1bb-4951-8df3-46a008c6424b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.784549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0613bc-f1bb-4951-8df3-46a008c6424b None admin] RBAC: Adding query filter params (interface=public, service_id=476efd90ed88429484b7d42b3e93cc8a, region_id=RegionOne) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:14.784893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0613bc-f1bb-4951-8df3-46a008c6424b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:14.786552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0613bc-f1bb-4951-8df3-46a008c6424b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:14.795794 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 394/783] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 10:20:14 2022] GET /identity/v3/endpoints?service_id=476efd90ed88429484b7d42b3e93cc8a&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:14.800480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0613bc-f1bb-4951-8df3-46a008c6424b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:14.822726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:14.848429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746bc0a-8bbf-4328-93d2-3d74855b2b97 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.886139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f97ce-e513-4a70-8752-7c2fc13b0733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.887149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f97ce-e513-4a70-8752-7c2fc13b0733 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.887575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f97ce-e513-4a70-8752-7c2fc13b0733 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.888128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f97ce-e513-4a70-8752-7c2fc13b0733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.901315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f97ce-e513-4a70-8752-7c2fc13b0733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:14.903307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f97ce-e513-4a70-8752-7c2fc13b0733 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fc9f97ce-e513-4a70-8752-7c2fc13b0733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:14.919777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:14.920812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:14.921705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:14.921705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:14.921705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:14.924115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 390/784] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:14.928787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0613bc-f1bb-4951-8df3-46a008c6424b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:14.930674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f97ce-e513-4a70-8752-7c2fc13b0733 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:14.979921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1060bf-ac33-4f4a-a269-fe27ca27e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:14.980872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1060bf-ac33-4f4a-a269-fe27ca27e675 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:14.981012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1060bf-ac33-4f4a-a269-fe27ca27e675 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:14.981292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1060bf-ac33-4f4a-a269-fe27ca27e675 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:14.981923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1060bf-ac33-4f4a-a269-fe27ca27e675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:14.983342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1060bf-ac33-4f4a-a269-fe27ca27e675 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:14.991460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 395/785] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 10:20:14 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:15.027210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:15.078504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f97ce-e513-4a70-8752-7c2fc13b0733 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:15.091551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0266e06-08dc-42ee-8233-bd33b2add8cb None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:15.091861 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0266e06-08dc-42ee-8233-bd33b2add8cb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:15.092107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0266e06-08dc-42ee-8233-bd33b2add8cb None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:15.093835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 396/786] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:20:15.100048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ffdf2-430d-4c9e-9685-d2ad4ad5917b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:15.100703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ffdf2-430d-4c9e-9685-d2ad4ad5917b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:15.101036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ffdf2-430d-4c9e-9685-d2ad4ad5917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:15.128707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-415ffdf2-430d-4c9e-9685-d2ad4ad5917b None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:15.129954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-415ffdf2-430d-4c9e-9685-d2ad4ad5917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:15.141203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200ac8a-d61f-433e-b9bc-bf6e52b7911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:15.141826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200ac8a-d61f-433e-b9bc-bf6e52b7911d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:15.142108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200ac8a-d61f-433e-b9bc-bf6e52b7911d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:15.142383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200ac8a-d61f-433e-b9bc-bf6e52b7911d None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:15.143105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200ac8a-d61f-433e-b9bc-bf6e52b7911d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:15.143416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200ac8a-d61f-433e-b9bc-bf6e52b7911d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:15.144799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200ac8a-d61f-433e-b9bc-bf6e52b7911d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:15.165133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 391/787] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:15.176481 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200ac8a-d61f-433e-b9bc-bf6e52b7911d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:15.253212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 397/788] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:15.321903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200ac8a-d61f-433e-b9bc-bf6e52b7911d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:15.346729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:15.370748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a0f00-e550-4dae-9f39-3f28cf6cf99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:15.371450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0f00-e550-4dae-9f39-3f28cf6cf99d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:15.371736 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0f00-e550-4dae-9f39-3f28cf6cf99d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:15.372012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0f00-e550-4dae-9f39-3f28cf6cf99d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:15.379875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a0f00-e550-4dae-9f39-3f28cf6cf99d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:15.381355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a0f00-e550-4dae-9f39-3f28cf6cf99d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f33a0f00-e550-4dae-9f39-3f28cf6cf99d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:15.396432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:15.397435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:15.399633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 392/789] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:15.405521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ffdf2-430d-4c9e-9685-d2ad4ad5917b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:15.422920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:15.565305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ffdf2-430d-4c9e-9685-d2ad4ad5917b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:15.600451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bb4bc-6d6b-42da-8ea7-cbd675190f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:15.601001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bb4bc-6d6b-42da-8ea7-cbd675190f2d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:15.601406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bb4bc-6d6b-42da-8ea7-cbd675190f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:15.601609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bb4bc-6d6b-42da-8ea7-cbd675190f2d None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:15.602320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bb4bc-6d6b-42da-8ea7-cbd675190f2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:15.602629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bb4bc-6d6b-42da-8ea7-cbd675190f2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:15.604482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a0f00-e550-4dae-9f39-3f28cf6cf99d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:15.606100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bb4bc-6d6b-42da-8ea7-cbd675190f2d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:15.638663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 398/790] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 10:20:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:15.648390 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bb4bc-6d6b-42da-8ea7-cbd675190f2d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:15.771975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a0f00-e550-4dae-9f39-3f28cf6cf99d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:15.779672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:15.819034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94eeed-6bca-4762-9277-408bff73ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:15.819677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94eeed-6bca-4762-9277-408bff73ce4f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:15.819957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94eeed-6bca-4762-9277-408bff73ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:15.820231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94eeed-6bca-4762-9277-408bff73ce4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:15.848650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94eeed-6bca-4762-9277-408bff73ce4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-df94eeed-6bca-4762-9277-408bff73ce4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:15.860868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:15.862809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:15.864210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 393/791] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:20:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:15.871911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94eeed-6bca-4762-9277-408bff73ce4f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:15.872205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bb4bc-6d6b-42da-8ea7-cbd675190f2d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:15.943929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714758d6-f1d1-4caa-b11f-eded5a9ba720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:15.944135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:15.944219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714758d6-f1d1-4caa-b11f-eded5a9ba720 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:15.944322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714758d6-f1d1-4caa-b11f-eded5a9ba720 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:15.944595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714758d6-f1d1-4caa-b11f-eded5a9ba720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:15.964706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714758d6-f1d1-4caa-b11f-eded5a9ba720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:15.966452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714758d6-f1d1-4caa-b11f-eded5a9ba720 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-714758d6-f1d1-4caa-b11f-eded5a9ba720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:15.998260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:15.999278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:16.000192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:16.000192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:16.000192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:16.002332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 399/792] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:16.003594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df941e-fb5a-4e19-9e09-cef17c216347 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.003876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df941e-fb5a-4e19-9e09-cef17c216347 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.004149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df941e-fb5a-4e19-9e09-cef17c216347 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.005798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 400/793] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:16.010930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff58cfa-cb4e-468b-9e26-c20d0aab1315 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.011220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff58cfa-cb4e-468b-9e26-c20d0aab1315 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.011488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff58cfa-cb4e-468b-9e26-c20d0aab1315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.029858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7ff58cfa-cb4e-468b-9e26-c20d0aab1315 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:16.031038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7ff58cfa-cb4e-468b-9e26-c20d0aab1315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:16.038103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94eeed-6bca-4762-9277-408bff73ce4f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:16.076734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894be37-9ba8-4fb9-b950-ab5a04769450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:16.077389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894be37-9ba8-4fb9-b950-ab5a04769450 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.077671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894be37-9ba8-4fb9-b950-ab5a04769450 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.077942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894be37-9ba8-4fb9-b950-ab5a04769450 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.078795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894be37-9ba8-4fb9-b950-ab5a04769450 None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:16.079107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894be37-9ba8-4fb9-b950-ab5a04769450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:16.080641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894be37-9ba8-4fb9-b950-ab5a04769450 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:16.090763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 394/794] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:20:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:16.091580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894be37-9ba8-4fb9-b950-ab5a04769450 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:16.100879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 401/795] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:20:16.101736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff58cfa-cb4e-468b-9e26-c20d0aab1315 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:16.162197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:16.250911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff58cfa-cb4e-468b-9e26-c20d0aab1315 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:16.309852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894be37-9ba8-4fb9-b950-ab5a04769450 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:16.320031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:16.323240 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562a5a7-a20d-4c29-b2a8-763ad16d6d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:16.323884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562a5a7-a20d-4c29-b2a8-763ad16d6d49 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.324156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562a5a7-a20d-4c29-b2a8-763ad16d6d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.324424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562a5a7-a20d-4c29-b2a8-763ad16d6d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.347253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990eeb-5cf1-4109-b726-0dd9dc7ed0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:16.348064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990eeb-5cf1-4109-b726-0dd9dc7ed0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.348494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990eeb-5cf1-4109-b726-0dd9dc7ed0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.348934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990eeb-5cf1-4109-b726-0dd9dc7ed0d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.349883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd990eeb-5cf1-4109-b726-0dd9dc7ed0d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:16.349999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562a5a7-a20d-4c29-b2a8-763ad16d6d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:16.350442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd990eeb-5cf1-4109-b726-0dd9dc7ed0d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:16.351376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562a5a7-a20d-4c29-b2a8-763ad16d6d49 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:16.352749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd990eeb-5cf1-4109-b726-0dd9dc7ed0d9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:16.376969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 395/796] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:16.381773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990eeb-5cf1-4109-b726-0dd9dc7ed0d9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-9562a5a7-a20d-4c29-b2a8-763ad16d6d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:16.394019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:16.395216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:16.396182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:16.396182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:16.396182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:16.396182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 402/797] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:16.405884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562a5a7-a20d-4c29-b2a8-763ad16d6d49 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:16.503134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990eeb-5cf1-4109-b726-0dd9dc7ed0d9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:16.544335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:16.547876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562a5a7-a20d-4c29-b2a8-763ad16d6d49 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:16.548182 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393d172-9d1d-4dd5-bf13-5cf65d1c12cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:16.549062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393d172-9d1d-4dd5-bf13-5cf65d1c12cd None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.549724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393d172-9d1d-4dd5-bf13-5cf65d1c12cd None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.550353 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393d172-9d1d-4dd5-bf13-5cf65d1c12cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.557880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393d172-9d1d-4dd5-bf13-5cf65d1c12cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:16.559900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393d172-9d1d-4dd5-bf13-5cf65d1c12cd None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b393d172-9d1d-4dd5-bf13-5cf65d1c12cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:16.573400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:16.575117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:16.576867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:16.576867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:16.576867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:16.576867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:16.576867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:16.576867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:16.576867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:16.576867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:16.580138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 396/798] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:16.582012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393d172-9d1d-4dd5-bf13-5cf65d1c12cd None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:16.599387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef22d3-c8db-4cbe-9ca4-845a1cbcf65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:16.600007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef22d3-c8db-4cbe-9ca4-845a1cbcf65f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.600294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef22d3-c8db-4cbe-9ca4-845a1cbcf65f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.600569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef22d3-c8db-4cbe-9ca4-845a1cbcf65f None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.601251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef22d3-c8db-4cbe-9ca4-845a1cbcf65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:16.601669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef22d3-c8db-4cbe-9ca4-845a1cbcf65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:16.603195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef22d3-c8db-4cbe-9ca4-845a1cbcf65f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:16.616079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:16.624122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 403/799] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:16.625038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef22d3-c8db-4cbe-9ca4-845a1cbcf65f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:16.697055 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393d172-9d1d-4dd5-bf13-5cf65d1c12cd None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:16.738337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bd0ce-6499-4d32-9afd-43a7bdc9028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:16.738974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bd0ce-6499-4d32-9afd-43a7bdc9028a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.739262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bd0ce-6499-4d32-9afd-43a7bdc9028a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.739532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bd0ce-6499-4d32-9afd-43a7bdc9028a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.742377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef22d3-c8db-4cbe-9ca4-845a1cbcf65f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:16.753921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bd0ce-6499-4d32-9afd-43a7bdc9028a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b71bd0ce-6499-4d32-9afd-43a7bdc9028a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:16.763729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:16.764624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:16.765516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:16.767101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 397/800] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:16.768217 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bd0ce-6499-4d32-9afd-43a7bdc9028a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:16.788258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7a142-c9e6-4033-b33b-87e0ea67b31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:16.789666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7a142-c9e6-4033-b33b-87e0ea67b31a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.790252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7a142-c9e6-4033-b33b-87e0ea67b31a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.790728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7a142-c9e6-4033-b33b-87e0ea67b31a None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.791669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7a142-c9e6-4033-b33b-87e0ea67b31a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:16.792231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7a142-c9e6-4033-b33b-87e0ea67b31a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:16.794052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7a142-c9e6-4033-b33b-87e0ea67b31a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:16.813933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 404/801] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:16.815194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7a142-c9e6-4033-b33b-87e0ea67b31a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:16.842803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:16.864621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:16.879553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bd0ce-6499-4d32-9afd-43a7bdc9028a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:16.917588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26880b4c-1e1d-4a3c-a7f8-69c323af36c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:16.918227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26880b4c-1e1d-4a3c-a7f8-69c323af36c9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.918585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26880b4c-1e1d-4a3c-a7f8-69c323af36c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.919103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26880b4c-1e1d-4a3c-a7f8-69c323af36c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.927816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26880b4c-1e1d-4a3c-a7f8-69c323af36c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:16.929468 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26880b4c-1e1d-4a3c-a7f8-69c323af36c9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-26880b4c-1e1d-4a3c-a7f8-69c323af36c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:16.941878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:16.942825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:16.943752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:16.943752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:16.943752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:16.943752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:16.943752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:16.943752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:16.943752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:16.943752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:16.943752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:16.943752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:16.948312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 398/802] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 10:20:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:16.949271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26880b4c-1e1d-4a3c-a7f8-69c323af36c9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:16.950913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7a142-c9e6-4033-b33b-87e0ea67b31a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:16.995499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87cedd-8608-49bc-ac7f-609da3aac1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:16.996979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87cedd-8608-49bc-ac7f-609da3aac1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:16.997554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87cedd-8608-49bc-ac7f-609da3aac1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:16.998016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87cedd-8608-49bc-ac7f-609da3aac1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:16.998994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87cedd-8608-49bc-ac7f-609da3aac1d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:16.999487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87cedd-8608-49bc-ac7f-609da3aac1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:17.001139 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87cedd-8608-49bc-ac7f-609da3aac1d0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:17.013449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 405/803] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:20:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:17.014727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87cedd-8608-49bc-ac7f-609da3aac1d0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:17.062030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26880b4c-1e1d-4a3c-a7f8-69c323af36c9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:17.098268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3e6d-f3ae-41a7-a703-8d383fc153a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:17.099028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3e6d-f3ae-41a7-a703-8d383fc153a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:17.099381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3e6d-f3ae-41a7-a703-8d383fc153a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:17.100429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3e6d-f3ae-41a7-a703-8d383fc153a2 None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/e5b380b92dc5438c92380c3fe2406590/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:17.102535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d3e6d-f3ae-41a7-a703-8d383fc153a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=e5b380b92dc5438c92380c3fe2406590, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:17.104080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d3e6d-f3ae-41a7-a703-8d383fc153a2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:17.116254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:17.129128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 399/804] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:20:16 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/e5b380b92dc5438c92380c3fe2406590/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:20:17.129128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3e6d-f3ae-41a7-a703-8d383fc153a2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:17.145675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:17.147581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87cedd-8608-49bc-ac7f-609da3aac1d0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:17.192447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58458e90-8bd2-4af5-8dca-e7ac705a9ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:17.193107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58458e90-8bd2-4af5-8dca-e7ac705a9ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:17.193394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58458e90-8bd2-4af5-8dca-e7ac705a9ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:17.195135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58458e90-8bd2-4af5-8dca-e7ac705a9ea3 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:17.197412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58458e90-8bd2-4af5-8dca-e7ac705a9ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:17.197671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58458e90-8bd2-4af5-8dca-e7ac705a9ea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:17.199955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58458e90-8bd2-4af5-8dca-e7ac705a9ea3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:17.239060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 406/805] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 10:20:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:17.248082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58458e90-8bd2-4af5-8dca-e7ac705a9ea3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:17.334929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d3e6d-f3ae-41a7-a703-8d383fc153a2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:17.390009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b16f5c-61f0-4224-87a0-fdb505c7236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:17.390649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b16f5c-61f0-4224-87a0-fdb505c7236f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:17.391050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b16f5c-61f0-4224-87a0-fdb505c7236f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:17.391332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b16f5c-61f0-4224-87a0-fdb505c7236f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:17.407272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b16f5c-61f0-4224-87a0-fdb505c7236f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:17.408756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b16f5c-61f0-4224-87a0-fdb505c7236f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:17.422120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58458e90-8bd2-4af5-8dca-e7ac705a9ea3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-45b16f5c-61f0-4224-87a0-fdb505c7236f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:17.426913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:17.428015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:17.429114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:17.429114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:17.429114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:17.432988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 400/806] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:17.434182 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e25658-e93b-4d42-9be4-b48aa4a10f79 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:17.434470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e25658-e93b-4d42-9be4-b48aa4a10f79 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:17.434755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e25658-e93b-4d42-9be4-b48aa4a10f79 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:17.436470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 401/807] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:17.438132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e25658-e93b-4d42-9be4-b48aa4a10f79 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:17.465764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd379d6-efad-4182-840a-a96457e7f749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:17.466329 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd379d6-efad-4182-840a-a96457e7f749 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:17.466614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd379d6-efad-4182-840a-a96457e7f749 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:17.466891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd379d6-efad-4182-840a-a96457e7f749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:17.476693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:17.480797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd379d6-efad-4182-840a-a96457e7f749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:17.482403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd379d6-efad-4182-840a-a96457e7f749 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-3dd379d6-efad-4182-840a-a96457e7f749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:17.500066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:17.501106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:17.502095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:17.502095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:17.502095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:17.502095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 407/808] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:17.503055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fa8d3-59a0-470b-8bc5-6dfe88de88ba None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:17.503344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fa8d3-59a0-470b-8bc5-6dfe88de88ba None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:17.503619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fa8d3-59a0-470b-8bc5-6dfe88de88ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:17.523075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-863fa8d3-59a0-470b-8bc5-6dfe88de88ba None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:17.524883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-863fa8d3-59a0-470b-8bc5-6dfe88de88ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:17.530472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:17.594455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e25658-e93b-4d42-9be4-b48aa4a10f79 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:17.602052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 408/809] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:17.602969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fa8d3-59a0-470b-8bc5-6dfe88de88ba None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:17.636701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7ee1c-9504-42f0-9809-343805bf61b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:17.637706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7ee1c-9504-42f0-9809-343805bf61b4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:17.638193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7ee1c-9504-42f0-9809-343805bf61b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:17.638696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7ee1c-9504-42f0-9809-343805bf61b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:17.639568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7ee1c-9504-42f0-9809-343805bf61b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:17.640074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7ee1c-9504-42f0-9809-343805bf61b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:17.641688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7ee1c-9504-42f0-9809-343805bf61b4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:17.655344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 402/810] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:17.656859 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8127068-f08c-4431-b747-cf96eda0dfc0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:17.657406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8127068-f08c-4431-b747-cf96eda0dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:17.657880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8127068-f08c-4431-b747-cf96eda0dfc0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:17.659517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 403/811] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:17.667307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18e990-e5fa-486a-8247-c81a276ee4df None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:17.667307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18e990-e5fa-486a-8247-c81a276ee4df None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:17.667307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18e990-e5fa-486a-8247-c81a276ee4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:17.688296 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7b18e990-e5fa-486a-8247-c81a276ee4df None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:17.689812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7b18e990-e5fa-486a-8247-c81a276ee4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:17.747202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fa8d3-59a0-470b-8bc5-6dfe88de88ba None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:17.772217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:17.781165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 404/812] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:17.781165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18e990-e5fa-486a-8247-c81a276ee4df None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:17.803425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6004b61-75d7-4193-8b51-93a3b31be0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:17.804041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6004b61-75d7-4193-8b51-93a3b31be0fb None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:17.804324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6004b61-75d7-4193-8b51-93a3b31be0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:17.804598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6004b61-75d7-4193-8b51-93a3b31be0fb None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:17.805950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6004b61-75d7-4193-8b51-93a3b31be0fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:17.806263 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6004b61-75d7-4193-8b51-93a3b31be0fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:17.807630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6004b61-75d7-4193-8b51-93a3b31be0fb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:17.819429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 409/813] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:17.825147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6004b61-75d7-4193-8b51-93a3b31be0fb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:17.880880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:17.959595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18e990-e5fa-486a-8247-c81a276ee4df None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:17.971600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6004b61-75d7-4193-8b51-93a3b31be0fb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:18.022372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2cfbe-f062-4160-bb67-cbfe5d117451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.023292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2cfbe-f062-4160-bb67-cbfe5d117451 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.023576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2cfbe-f062-4160-bb67-cbfe5d117451 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.023939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2cfbe-f062-4160-bb67-cbfe5d117451 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.029218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f60dda-2920-4a9b-8844-89500af9abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.029932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60dda-2920-4a9b-8844-89500af9abf0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.030216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60dda-2920-4a9b-8844-89500af9abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.030490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60dda-2920-4a9b-8844-89500af9abf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.033311 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2cfbe-f062-4160-bb67-cbfe5d117451 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.035244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2cfbe-f062-4160-bb67-cbfe5d117451 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:18.038471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f60dda-2920-4a9b-8844-89500af9abf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.040423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f60dda-2920-4a9b-8844-89500af9abf0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-fbc2cfbe-f062-4160-bb67-cbfe5d117451 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:18.049107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:18.050030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:18.050965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:18.050965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:18.050965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:18.050965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:18.050965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:18.050965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:18.050965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:18.050965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:18.050965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:18.050965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-53f60dda-2920-4a9b-8844-89500af9abf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:18.056983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:18.057859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:18.059583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:18.059583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:18.059583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:18.059583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:18.059583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:18.059583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:18.059583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:18.059583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:18.060442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 405/815] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 10:20:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:18.060442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2cfbe-f062-4160-bb67-cbfe5d117451 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:18.060694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 410/815] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:18.060694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f60dda-2920-4a9b-8844-89500af9abf0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:18.108789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:18.167066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2cfbe-f062-4160-bb67-cbfe5d117451 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:18.170412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f60dda-2920-4a9b-8844-89500af9abf0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:18.176608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:18.205331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d19e-cf2a-4cc2-853b-aba17f8022c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.205501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ed8ee-fcc0-41ad-a57d-9591d29598b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.205939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d19e-cf2a-4cc2-853b-aba17f8022c9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.206042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ed8ee-fcc0-41ad-a57d-9591d29598b3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.206221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d19e-cf2a-4cc2-853b-aba17f8022c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.206346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ed8ee-fcc0-41ad-a57d-9591d29598b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.206496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d19e-cf2a-4cc2-853b-aba17f8022c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.206596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ed8ee-fcc0-41ad-a57d-9591d29598b3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.207071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ed8ee-fcc0-41ad-a57d-9591d29598b3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.207164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223d19e-cf2a-4cc2-853b-aba17f8022c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:18.207465 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223d19e-cf2a-4cc2-853b-aba17f8022c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.208482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ed8ee-fcc0-41ad-a57d-9591d29598b3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:18.208856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223d19e-cf2a-4cc2-853b-aba17f8022c9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f06ed8ee-fcc0-41ad-a57d-9591d29598b3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:18.217340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:18.218276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:18.219970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 406/816] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:18 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:18.220755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ed8ee-fcc0-41ad-a57d-9591d29598b3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:18.229282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 411/817] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:18.230916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d19e-cf2a-4cc2-853b-aba17f8022c9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:18.326510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ed8ee-fcc0-41ad-a57d-9591d29598b3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:18.329794 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d19e-cf2a-4cc2-853b-aba17f8022c9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:18.331276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:18.368311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df168618-3577-4a38-8edd-9d642f5c7c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.369023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168618-3577-4a38-8edd-9d642f5c7c87 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.369251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168618-3577-4a38-8edd-9d642f5c7c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.369518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168618-3577-4a38-8edd-9d642f5c7c87 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.370092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df168618-3577-4a38-8edd-9d642f5c7c87 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.370565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74892ef5-4a5e-4105-a1de-6996510d92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.371173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74892ef5-4a5e-4105-a1de-6996510d92d9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.371437 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df168618-3577-4a38-8edd-9d642f5c7c87 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:18.371543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74892ef5-4a5e-4105-a1de-6996510d92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.371708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74892ef5-4a5e-4105-a1de-6996510d92d9 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.372432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74892ef5-4a5e-4105-a1de-6996510d92d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:18.372737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74892ef5-4a5e-4105-a1de-6996510d92d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.374439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74892ef5-4a5e-4105-a1de-6996510d92d9 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-df168618-3577-4a38-8edd-9d642f5c7c87 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:18.380346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:18.381562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:18.382411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 412/818] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Sep 26 10:20:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:18.383739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df168618-3577-4a38-8edd-9d642f5c7c87 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:18.396927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 407/819] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 10:20:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:18.397848 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74892ef5-4a5e-4105-a1de-6996510d92d9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:18.434690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:18.496212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df168618-3577-4a38-8edd-9d642f5c7c87 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:18.509795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74892ef5-4a5e-4105-a1de-6996510d92d9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:18.531246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af701-0235-4a44-8f4c-740ee028aada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.531856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af701-0235-4a44-8f4c-740ee028aada None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.532137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af701-0235-4a44-8f4c-740ee028aada None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.532416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af701-0235-4a44-8f4c-740ee028aada None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.533071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af701-0235-4a44-8f4c-740ee028aada None admin] RBAC: Adding query filter params (name=network) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:18.533399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af701-0235-4a44-8f4c-740ee028aada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.534748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af701-0235-4a44-8f4c-740ee028aada None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:18.543744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 413/820] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:18.543744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af701-0235-4a44-8f4c-740ee028aada None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:18.555910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ffb6f-ff28-48ca-ad18-615409c1b662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.556877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ffb6f-ff28-48ca-ad18-615409c1b662 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.557354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ffb6f-ff28-48ca-ad18-615409c1b662 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.557628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ffb6f-ff28-48ca-ad18-615409c1b662 None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/ecdfe8d98368455db8b67097051b9e1c/roles/c2bcddceaa5642beb73d7d1012bd46ec` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.572731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ffb6f-ff28-48ca-ad18-615409c1b662 None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=ecdfe8d98368455db8b67097051b9e1c, role_id=c2bcddceaa5642beb73d7d1012bd46ec)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.574194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ffb6f-ff28-48ca-ad18-615409c1b662 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:18.576183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:18.588618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 408/821] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:20:18 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/ecdfe8d98368455db8b67097051b9e1c/roles/c2bcddceaa5642beb73d7d1012bd46ec => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:20:18.590020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ffb6f-ff28-48ca-ad18-615409c1b662 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:18.661941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af701-0235-4a44-8f4c-740ee028aada None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:18.705384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38cd0d-989f-4c95-af59-91405536b32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.706316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38cd0d-989f-4c95-af59-91405536b32c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.706770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38cd0d-989f-4c95-af59-91405536b32c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.707195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38cd0d-989f-4c95-af59-91405536b32c None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.708068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38cd0d-989f-4c95-af59-91405536b32c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:18.708537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38cd0d-989f-4c95-af59-91405536b32c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.710179 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38cd0d-989f-4c95-af59-91405536b32c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:18.720990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 414/822] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 10:20:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:18.722241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38cd0d-989f-4c95-af59-91405536b32c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:18.833755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:18.840879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:18.847235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38cd0d-989f-4c95-af59-91405536b32c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:18.856888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ffb6f-ff28-48ca-ad18-615409c1b662 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:18.883713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ff70e-82ac-473f-856d-f15e002468f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.884325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ff70e-82ac-473f-856d-f15e002468f7 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.884614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ff70e-82ac-473f-856d-f15e002468f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.884913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ff70e-82ac-473f-856d-f15e002468f7 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.885561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ff70e-82ac-473f-856d-f15e002468f7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:18.885861 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ff70e-82ac-473f-856d-f15e002468f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.887211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ff70e-82ac-473f-856d-f15e002468f7 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:18.896853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 415/823] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:18.898036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ff70e-82ac-473f-856d-f15e002468f7 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:18.900324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62101842-8432-42c1-a915-f54bf38d7e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:18.900940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62101842-8432-42c1-a915-f54bf38d7e24 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:18.901690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62101842-8432-42c1-a915-f54bf38d7e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:18.901967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62101842-8432-42c1-a915-f54bf38d7e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:18.989370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62101842-8432-42c1-a915-f54bf38d7e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:18.990759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62101842-8432-42c1-a915-f54bf38d7e24 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:19.005409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ff70e-82ac-473f-856d-f15e002468f7 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:19.042443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df93430-6705-4324-8a8d-0b01867092de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:19.043159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df93430-6705-4324-8a8d-0b01867092de None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:19.043502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df93430-6705-4324-8a8d-0b01867092de None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:19.043925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df93430-6705-4324-8a8d-0b01867092de None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:19.044619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df93430-6705-4324-8a8d-0b01867092de None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:19.045024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df93430-6705-4324-8a8d-0b01867092de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:19.046526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df93430-6705-4324-8a8d-0b01867092de None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:19.052023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 416/824] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 10:20:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:19.052968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df93430-6705-4324-8a8d-0b01867092de None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:19.089338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:19.097092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:19.124219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 409/825] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:20:19.125064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62101842-8432-42c1-a915-f54bf38d7e24 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:19.174704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df93430-6705-4324-8a8d-0b01867092de None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:19.214960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab8a04-1407-4c7b-b407-df0b011c5bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:19.215887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8a04-1407-4c7b-b407-df0b011c5bd4 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:19.216381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8a04-1407-4c7b-b407-df0b011c5bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:19.216859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8a04-1407-4c7b-b407-df0b011c5bd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:19.217740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab8a04-1407-4c7b-b407-df0b011c5bd4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:19.219290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab8a04-1407-4c7b-b407-df0b011c5bd4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:19.244804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 417/826] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:20:19 2022] POST /identity/v3/endpoints => generated 337 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:19.246018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab8a04-1407-4c7b-b407-df0b011c5bd4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:19.260127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62101842-8432-42c1-a915-f54bf38d7e24 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:19.331275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3286a0-2e43-4ed6-aa5a-ac0a8e91f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:19.338287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3286a0-2e43-4ed6-aa5a-ac0a8e91f4b7 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:19.338522 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3286a0-2e43-4ed6-aa5a-ac0a8e91f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:19.338601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3286a0-2e43-4ed6-aa5a-ac0a8e91f4b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:19.339362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3286a0-2e43-4ed6-aa5a-ac0a8e91f4b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:19.340616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:19.342183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3286a0-2e43-4ed6-aa5a-ac0a8e91f4b7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:19.374154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 410/827] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:20:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:19.401934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab8a04-1407-4c7b-b407-df0b011c5bd4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:19.452745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5b87-9fe6-48a3-932f-b74cc194b0ac None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:19.453133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5b87-9fe6-48a3-932f-b74cc194b0ac None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:19.453348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5b87-9fe6-48a3-932f-b74cc194b0ac None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:19.455007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 411/828] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:20:19.460708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ad97c-e4d6-4c80-a955-f9f0ae9a372a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:19.461051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ad97c-e4d6-4c80-a955-f9f0ae9a372a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:19.461335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ad97c-e4d6-4c80-a955-f9f0ae9a372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:19.478034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08636e84-6c31-4406-8fdf-d52513a0099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:19.478699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08636e84-6c31-4406-8fdf-d52513a0099d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:19.478979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08636e84-6c31-4406-8fdf-d52513a0099d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:19.479250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08636e84-6c31-4406-8fdf-d52513a0099d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:19.485679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-aa4ad97c-e4d6-4c80-a955-f9f0ae9a372a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:19.487317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-aa4ad97c-e4d6-4c80-a955-f9f0ae9a372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:19.510567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08636e84-6c31-4406-8fdf-d52513a0099d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:19.512019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08636e84-6c31-4406-8fdf-d52513a0099d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-08636e84-6c31-4406-8fdf-d52513a0099d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:19.541245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:19.542243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:19.543587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:19.543587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:19.543587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:19.543587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 418/829] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:19.548894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08636e84-6c31-4406-8fdf-d52513a0099d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:19.553341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:19.619961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 412/830] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:20:19.695057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08636e84-6c31-4406-8fdf-d52513a0099d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:19.745322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:19.753811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbface13-3a97-414d-ab91-d3e38a9cb2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:19.754421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbface13-3a97-414d-ab91-d3e38a9cb2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:19.754698 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbface13-3a97-414d-ab91-d3e38a9cb2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:19.754968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbface13-3a97-414d-ab91-d3e38a9cb2b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:19.755611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbface13-3a97-414d-ab91-d3e38a9cb2b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:19.755911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbface13-3a97-414d-ab91-d3e38a9cb2b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:19.759432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbface13-3a97-414d-ab91-d3e38a9cb2b6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:19.771924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 419/831] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:19.778022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ad97c-e4d6-4c80-a955-f9f0ae9a372a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:19.879244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ad97c-e4d6-4c80-a955-f9f0ae9a372a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:19.909590 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbface13-3a97-414d-ab91-d3e38a9cb2b6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:19.919580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55cafb-b202-46d4-a18a-3e0d681ce2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:19.920897 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55cafb-b202-46d4-a18a-3e0d681ce2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:19.921422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55cafb-b202-46d4-a18a-3e0d681ce2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:19.921944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55cafb-b202-46d4-a18a-3e0d681ce2e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:19.929522 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55cafb-b202-46d4-a18a-3e0d681ce2e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:19.931932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55cafb-b202-46d4-a18a-3e0d681ce2e0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4e55cafb-b202-46d4-a18a-3e0d681ce2e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:19.944580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:19.945725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:19.946590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:19.946590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:19.946590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:19.946590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:19.946590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:19.946590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:19.946590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:19.946590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:19.953474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 413/832] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:19.954619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55cafb-b202-46d4-a18a-3e0d681ce2e0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:19.983807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:20.037148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbface13-3a97-414d-ab91-d3e38a9cb2b6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:20.076385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d632a57-2d42-4c6a-834a-663dca3c22a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:20.077059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d632a57-2d42-4c6a-834a-663dca3c22a1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:20.077340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d632a57-2d42-4c6a-834a-663dca3c22a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:20.077610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d632a57-2d42-4c6a-834a-663dca3c22a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:20.087615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55cafb-b202-46d4-a18a-3e0d681ce2e0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:20.089326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d632a57-2d42-4c6a-834a-663dca3c22a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-6d632a57-2d42-4c6a-834a-663dca3c22a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:20.095536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:20.096651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:20.097538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 420/833] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:20.105814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d632a57-2d42-4c6a-834a-663dca3c22a1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:20.137397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91615190-c8c8-4dc5-b231-fbdaaf09ec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:20.138011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91615190-c8c8-4dc5-b231-fbdaaf09ec22 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:20.138314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91615190-c8c8-4dc5-b231-fbdaaf09ec22 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:20.138717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91615190-c8c8-4dc5-b231-fbdaaf09ec22 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:20.139409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91615190-c8c8-4dc5-b231-fbdaaf09ec22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:20.140037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91615190-c8c8-4dc5-b231-fbdaaf09ec22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:20.141757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91615190-c8c8-4dc5-b231-fbdaaf09ec22 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:20.163998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 414/834] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:20.166006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91615190-c8c8-4dc5-b231-fbdaaf09ec22 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:20.166875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:20.231899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d632a57-2d42-4c6a-834a-663dca3c22a1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:20.271744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:20.272254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda93ba-a7bd-46c4-8c25-58981eca9002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:20.273586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda93ba-a7bd-46c4-8c25-58981eca9002 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:20.274162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda93ba-a7bd-46c4-8c25-58981eca9002 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:20.274609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda93ba-a7bd-46c4-8c25-58981eca9002 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:20.275459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda93ba-a7bd-46c4-8c25-58981eca9002 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:20.275948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda93ba-a7bd-46c4-8c25-58981eca9002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:20.278382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda93ba-a7bd-46c4-8c25-58981eca9002 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:20.288104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 421/835] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:20:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:20.294361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda93ba-a7bd-46c4-8c25-58981eca9002 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:20.297011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91615190-c8c8-4dc5-b231-fbdaaf09ec22 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:20.345339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268686a-2762-4858-bb41-5eff9fa027ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:20.346735 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268686a-2762-4858-bb41-5eff9fa027ba None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:20.347198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268686a-2762-4858-bb41-5eff9fa027ba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:20.347918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268686a-2762-4858-bb41-5eff9fa027ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:20.348824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268686a-2762-4858-bb41-5eff9fa027ba None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=e58300ef26a547028e837ba2da615991) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:20.349324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268686a-2762-4858-bb41-5eff9fa027ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:20.351685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268686a-2762-4858-bb41-5eff9fa027ba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:20.369361 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 415/836] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:20 2022] GET /identity/v3/role_assignments?user.id=e58300ef26a547028e837ba2da615991&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:20.424913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda93ba-a7bd-46c4-8c25-58981eca9002 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:20.435023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:20.463841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda24e8-7d1b-4f97-987c-9b12b2eee6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:20.464587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda24e8-7d1b-4f97-987c-9b12b2eee6af None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:20.464869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda24e8-7d1b-4f97-987c-9b12b2eee6af None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:20.465169 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda24e8-7d1b-4f97-987c-9b12b2eee6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:20.477919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda24e8-7d1b-4f97-987c-9b12b2eee6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:20.479369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda24e8-7d1b-4f97-987c-9b12b2eee6af None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-9fda24e8-7d1b-4f97-987c-9b12b2eee6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:20.495410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:20.496416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:20.497325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:20.497325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:20.497325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:20.497325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 422/837] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:20.502755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268686a-2762-4858-bb41-5eff9fa027ba None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:20.612337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268686a-2762-4858-bb41-5eff9fa027ba None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:20.647632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c84d2-5776-44d9-a3c9-2d818b98b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:20.648240 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c84d2-5776-44d9-a3c9-2d818b98b5fc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:20.648517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c84d2-5776-44d9-a3c9-2d818b98b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:20.649347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c84d2-5776-44d9-a3c9-2d818b98b5fc None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:20.649983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c84d2-5776-44d9-a3c9-2d818b98b5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:20.650284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c84d2-5776-44d9-a3c9-2d818b98b5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:20.651960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c84d2-5776-44d9-a3c9-2d818b98b5fc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:20.669036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 416/838] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:20.670490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda24e8-7d1b-4f97-987c-9b12b2eee6af None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:20.773370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda24e8-7d1b-4f97-987c-9b12b2eee6af None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:20.809758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459ea36-be7a-4135-93ac-df5d5e74b12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:20.810775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459ea36-be7a-4135-93ac-df5d5e74b12f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:20.811261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459ea36-be7a-4135-93ac-df5d5e74b12f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:20.811736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459ea36-be7a-4135-93ac-df5d5e74b12f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:20.820324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459ea36-be7a-4135-93ac-df5d5e74b12f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:20.822320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459ea36-be7a-4135-93ac-df5d5e74b12f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-c459ea36-be7a-4135-93ac-df5d5e74b12f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:20.835619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:20.837204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:20.838144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:20.838144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:20.838144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:20.838144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:20.838144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:20.838144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:20.838144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:20.838144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:20.838144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 10:20:20.838144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:20.840922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 423/839] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:20.852995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c84d2-5776-44d9-a3c9-2d818b98b5fc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:20.856582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:20.946031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421e5b-e26e-44f2-b226-8f7375a0101a None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:20.946645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421e5b-e26e-44f2-b226-8f7375a0101a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:20.947110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421e5b-e26e-44f2-b226-8f7375a0101a None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:20.948858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 424/840] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:20:20.954695 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afab6c-be76-4853-aede-209bdc971f9d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:20.954982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afab6c-be76-4853-aede-209bdc971f9d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:20.955089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c84d2-5776-44d9-a3c9-2d818b98b5fc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:20.955488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afab6c-be76-4853-aede-209bdc971f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:20.974244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d1afab6c-be76-4853-aede-209bdc971f9d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:20.975548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d1afab6c-be76-4853-aede-209bdc971f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:20.991259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:20.992252 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b512ba3-ebf5-47c3-9905-387f60b450c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:20.993451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b512ba3-ebf5-47c3-9905-387f60b450c4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:20.993872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b512ba3-ebf5-47c3-9905-387f60b450c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:20.994381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b512ba3-ebf5-47c3-9905-387f60b450c4 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:20.995269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b512ba3-ebf5-47c3-9905-387f60b450c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:20.995833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b512ba3-ebf5-47c3-9905-387f60b450c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:20.997506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b512ba3-ebf5-47c3-9905-387f60b450c4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:21.017780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 417/841] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 10:20:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:21.023421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b512ba3-ebf5-47c3-9905-387f60b450c4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:21.058144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 425/842] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:20:21.102368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:21.146610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b512ba3-ebf5-47c3-9905-387f60b450c4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:21.182840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152fd2e-9e22-4fe2-ade4-03591932f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:21.183443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152fd2e-9e22-4fe2-ade4-03591932f522 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:21.183719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152fd2e-9e22-4fe2-ade4-03591932f522 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:21.183985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152fd2e-9e22-4fe2-ade4-03591932f522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:21.253123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152fd2e-9e22-4fe2-ade4-03591932f522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:21.254475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152fd2e-9e22-4fe2-ade4-03591932f522 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:21.322204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:21.328453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afab6c-be76-4853-aede-209bdc971f9d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:21.353970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 418/843] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:20:21.362028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152fd2e-9e22-4fe2-ade4-03591932f522 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:21.448851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afab6c-be76-4853-aede-209bdc971f9d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:21.474764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152fd2e-9e22-4fe2-ade4-03591932f522 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:21.491262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3db7f-b95e-4d61-8fdc-062c7daa2be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:21.491892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3db7f-b95e-4d61-8fdc-062c7daa2be8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:21.492172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3db7f-b95e-4d61-8fdc-062c7daa2be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:21.492974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3db7f-b95e-4d61-8fdc-062c7daa2be8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:21.509391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3db7f-b95e-4d61-8fdc-062c7daa2be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:21.512802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78ef9-5c03-4de2-98b5-3dbda13c86da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:21.513620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78ef9-5c03-4de2-98b5-3dbda13c86da None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:21.514004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78ef9-5c03-4de2-98b5-3dbda13c86da None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:21.514378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78ef9-5c03-4de2-98b5-3dbda13c86da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-9ed3db7f-b95e-4d61-8fdc-062c7daa2be8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:21.515949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:21.517014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:20:21.518059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:21.520397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 426/844] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:20:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:21.527023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3db7f-b95e-4d61-8fdc-062c7daa2be8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:21.533490 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d78ef9-5c03-4de2-98b5-3dbda13c86da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:21.535733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d78ef9-5c03-4de2-98b5-3dbda13c86da None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-23d78ef9-5c03-4de2-98b5-3dbda13c86da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:21.553534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:21.554498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:21.555944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:21.555944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:21.555944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:21.555944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 419/845] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:21.557272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:21.560830 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78ef9-5c03-4de2-98b5-3dbda13c86da None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:21.580221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:21.659142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3db7f-b95e-4d61-8fdc-062c7daa2be8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:21.693837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78ef9-5c03-4de2-98b5-3dbda13c86da None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:21.697826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10def-3802-4115-8b8c-7d15d2696207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:21.698688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10def-3802-4115-8b8c-7d15d2696207 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:21.699182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10def-3802-4115-8b8c-7d15d2696207 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:21.699651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10def-3802-4115-8b8c-7d15d2696207 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:21.700505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b10def-3802-4115-8b8c-7d15d2696207 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:21.701031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b10def-3802-4115-8b8c-7d15d2696207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:21.703127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b10def-3802-4115-8b8c-7d15d2696207 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:21.714083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 427/846] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:20:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:21.719232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10def-3802-4115-8b8c-7d15d2696207 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:21.733165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f0a15-43f3-40ff-a9dd-989f9eb35c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:21.733800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f0a15-43f3-40ff-a9dd-989f9eb35c1c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:21.734088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f0a15-43f3-40ff-a9dd-989f9eb35c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:21.734370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f0a15-43f3-40ff-a9dd-989f9eb35c1c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:21.734987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f0a15-43f3-40ff-a9dd-989f9eb35c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:21.735289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f0a15-43f3-40ff-a9dd-989f9eb35c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:21.736756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f0a15-43f3-40ff-a9dd-989f9eb35c1c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:21.753270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 420/847] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:21.754415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30df68-3cce-4d45-96d1-c0733b6667d0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:21.754701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30df68-3cce-4d45-96d1-c0733b6667d0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:21.754975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30df68-3cce-4d45-96d1-c0733b6667d0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:21.756190 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 421/848] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:21.757884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30df68-3cce-4d45-96d1-c0733b6667d0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:21.798043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:21.828418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10def-3802-4115-8b8c-7d15d2696207 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:21.850241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:21.866735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c97a2-1341-45b4-ae83-4a0b68cd0813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:21.867365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c97a2-1341-45b4-ae83-4a0b68cd0813 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:21.867673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c97a2-1341-45b4-ae83-4a0b68cd0813 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:21.867917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c97a2-1341-45b4-ae83-4a0b68cd0813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:21.877304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30df68-3cce-4d45-96d1-c0733b6667d0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:21.878170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c97a2-1341-45b4-ae83-4a0b68cd0813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:21.879584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c97a2-1341-45b4-ae83-4a0b68cd0813 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-1e7c97a2-1341-45b4-ae83-4a0b68cd0813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:21.894522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:21.895650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:21.896847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:21.896847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:21.896847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:21.900843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 428/849] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:21.902348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0811d0-3d3f-4502-91ce-2cf12eb99b93 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:21.902630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0811d0-3d3f-4502-91ce-2cf12eb99b93 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:21.902901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0811d0-3d3f-4502-91ce-2cf12eb99b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:21.915886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e375f7-04fb-48d4-b67e-4e2b48ec5b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:21.916507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e375f7-04fb-48d4-b67e-4e2b48ec5b08 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:21.916784 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e375f7-04fb-48d4-b67e-4e2b48ec5b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:21.917098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e375f7-04fb-48d4-b67e-4e2b48ec5b08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:21.921586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1b0811d0-3d3f-4502-91ce-2cf12eb99b93 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:21.922951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1b0811d0-3d3f-4502-91ce-2cf12eb99b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:21.923762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e375f7-04fb-48d4-b67e-4e2b48ec5b08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:21.925200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e375f7-04fb-48d4-b67e-4e2b48ec5b08 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b2e375f7-04fb-48d4-b67e-4e2b48ec5b08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:21.937270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:21.938210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:21.939066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:21.939066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:21.939066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:21.939066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:21.939066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:21.939066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:21.939066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:21.939066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:21.939066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 422/850] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:21.939066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e375f7-04fb-48d4-b67e-4e2b48ec5b08 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:21.998953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 429/851] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:22.001190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0811d0-3d3f-4502-91ce-2cf12eb99b93 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:22.064644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:22.068398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e375f7-04fb-48d4-b67e-4e2b48ec5b08 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:22.106164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712b547-0acc-438b-85fd-70e0cd5b0957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:22.106887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712b547-0acc-438b-85fd-70e0cd5b0957 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.107260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712b547-0acc-438b-85fd-70e0cd5b0957 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.107512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712b547-0acc-438b-85fd-70e0cd5b0957 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.108270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712b547-0acc-438b-85fd-70e0cd5b0957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:22.108644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712b547-0acc-438b-85fd-70e0cd5b0957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:22.110285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712b547-0acc-438b-85fd-70e0cd5b0957 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:22.112672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:22.113313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0811d0-3d3f-4502-91ce-2cf12eb99b93 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:22.128720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 423/852] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:22.130690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712b547-0acc-438b-85fd-70e0cd5b0957 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:22.157660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65416c17-c3c7-485f-9939-8c7aec724c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:22.158340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65416c17-c3c7-485f-9939-8c7aec724c94 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.158609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65416c17-c3c7-485f-9939-8c7aec724c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.158890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65416c17-c3c7-485f-9939-8c7aec724c94 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.159672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65416c17-c3c7-485f-9939-8c7aec724c94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:22.159982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65416c17-c3c7-485f-9939-8c7aec724c94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:22.161420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65416c17-c3c7-485f-9939-8c7aec724c94 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:22.176554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 430/853] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:22.182823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65416c17-c3c7-485f-9939-8c7aec724c94 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:22.255696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712b547-0acc-438b-85fd-70e0cd5b0957 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:22.300926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186280-ef9a-48c0-974c-13dab71b1a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:22.301572 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186280-ef9a-48c0-974c-13dab71b1a89 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.301851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186280-ef9a-48c0-974c-13dab71b1a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.302121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186280-ef9a-48c0-974c-13dab71b1a89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.303340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65416c17-c3c7-485f-9939-8c7aec724c94 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:22.310211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b186280-ef9a-48c0-974c-13dab71b1a89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:22.312063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b186280-ef9a-48c0-974c-13dab71b1a89 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:22.318079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-7b186280-ef9a-48c0-974c-13dab71b1a89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:22.325950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:22.327086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 424/854] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 10:20:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:22.328024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186280-ef9a-48c0-974c-13dab71b1a89 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:22.345268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfedcb1-9213-4b0c-be8e-f097e0311155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:22.345872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfedcb1-9213-4b0c-be8e-f097e0311155 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.346147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfedcb1-9213-4b0c-be8e-f097e0311155 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.346508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfedcb1-9213-4b0c-be8e-f097e0311155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.347223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfedcb1-9213-4b0c-be8e-f097e0311155 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=e5b380b92dc5438c92380c3fe2406590) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:22.347527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfedcb1-9213-4b0c-be8e-f097e0311155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:22.348930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfedcb1-9213-4b0c-be8e-f097e0311155 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:22.357016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 431/855] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:22 2022] GET /identity/v3/role_assignments?user.id=e5b380b92dc5438c92380c3fe2406590&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:22.358126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfedcb1-9213-4b0c-be8e-f097e0311155 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:22.407162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:22.457635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186280-ef9a-48c0-974c-13dab71b1a89 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:22.495498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a974050-263c-4dda-af5c-93fce9132265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:22.496140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974050-263c-4dda-af5c-93fce9132265 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.496417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974050-263c-4dda-af5c-93fce9132265 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.496685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974050-263c-4dda-af5c-93fce9132265 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.497381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a974050-263c-4dda-af5c-93fce9132265 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:22.498820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a974050-263c-4dda-af5c-93fce9132265 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3a974050-263c-4dda-af5c-93fce9132265 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:22.509138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:22.510172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:22.516074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 425/856] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:20:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:22.517203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfedcb1-9213-4b0c-be8e-f097e0311155 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:22.518889 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a974050-263c-4dda-af5c-93fce9132265 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:22.555963 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b4af-a3ee-46fe-bb1e-35909e3777a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:22.556604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b4af-a3ee-46fe-bb1e-35909e3777a3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.556880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b4af-a3ee-46fe-bb1e-35909e3777a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.557200 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b4af-a3ee-46fe-bb1e-35909e3777a3 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.557937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b4af-a3ee-46fe-bb1e-35909e3777a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:22.558260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b4af-a3ee-46fe-bb1e-35909e3777a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:22.559698 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b4af-a3ee-46fe-bb1e-35909e3777a3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:22.582887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 432/857] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 10:20:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:22.590298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b4af-a3ee-46fe-bb1e-35909e3777a3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:22.638011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:22.652757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a974050-263c-4dda-af5c-93fce9132265 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:22.678014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:22.699352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bfd4d-1af9-498e-9953-dbbf614384b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:22.699969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bfd4d-1af9-498e-9953-dbbf614384b3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.700249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bfd4d-1af9-498e-9953-dbbf614384b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.700518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bfd4d-1af9-498e-9953-dbbf614384b3 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.701675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bfd4d-1af9-498e-9953-dbbf614384b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:22.701984 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bfd4d-1af9-498e-9953-dbbf614384b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:22.703817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bfd4d-1af9-498e-9953-dbbf614384b3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:22.712987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 426/858] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:20:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:22.712987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910d23-ec20-4bfd-ae1f-e629fa841115 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.713262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910d23-ec20-4bfd-ae1f-e629fa841115 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.713382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910d23-ec20-4bfd-ae1f-e629fa841115 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.714018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b4af-a3ee-46fe-bb1e-35909e3777a3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:22.714871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 427/859] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:22.717628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b910d23-ec20-4bfd-ae1f-e629fa841115 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:22.750075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcde42-ecda-4c49-b553-0e473e9aa26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:22.750682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcde42-ecda-4c49-b553-0e473e9aa26b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.750961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcde42-ecda-4c49-b553-0e473e9aa26b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.751231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcde42-ecda-4c49-b553-0e473e9aa26b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.823780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcde42-ecda-4c49-b553-0e473e9aa26b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:22.825288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcde42-ecda-4c49-b553-0e473e9aa26b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:22.828690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b910d23-ec20-4bfd-ae1f-e629fa841115 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:22.862377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:22.866737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29742b6f-0b25-49c4-b220-d96ac21bdcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:22.868513 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29742b6f-0b25-49c4-b220-d96ac21bdcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.868872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29742b6f-0b25-49c4-b220-d96ac21bdcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.869173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29742b6f-0b25-49c4-b220-d96ac21bdcf2 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.869804 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29742b6f-0b25-49c4-b220-d96ac21bdcf2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:22.870455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29742b6f-0b25-49c4-b220-d96ac21bdcf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:22.872201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29742b6f-0b25-49c4-b220-d96ac21bdcf2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:22.881091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 428/860] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:20:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:22.882847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cddf66-74d5-4252-9131-3b80a34e1ff4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:22.884000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cddf66-74d5-4252-9131-3b80a34e1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:22.884480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cddf66-74d5-4252-9131-3b80a34e1ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:22.905572 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e8cddf66-74d5-4252-9131-3b80a34e1ff4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:22.907295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e8cddf66-74d5-4252-9131-3b80a34e1ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:22.950090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 433/861] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:20:22.952018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcde42-ecda-4c49-b553-0e473e9aa26b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:22.970453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:23.006910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 429/862] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:23.074883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcde42-ecda-4c49-b553-0e473e9aa26b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:23.111800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1f4c4-e059-47b7-aebb-16d468bf34dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:23.112839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1f4c4-e059-47b7-aebb-16d468bf34dc None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:23.113350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1f4c4-e059-47b7-aebb-16d468bf34dc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:23.113821 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1f4c4-e059-47b7-aebb-16d468bf34dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:23.116811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:23.126587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1f4c4-e059-47b7-aebb-16d468bf34dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:23.128301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1f4c4-e059-47b7-aebb-16d468bf34dc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-78a1f4c4-e059-47b7-aebb-16d468bf34dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:23.143960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:23.144926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:23.145834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:23.145834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:23.145834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:23.147898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 434/863] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:23.161211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cddf66-74d5-4252-9131-3b80a34e1ff4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:23.264701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cddf66-74d5-4252-9131-3b80a34e1ff4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:23.288179 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1f4c4-e059-47b7-aebb-16d468bf34dc None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:23.304349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562d86d-94a6-4c44-9b29-62762bd156d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:23.305678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562d86d-94a6-4c44-9b29-62762bd156d0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:23.306243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562d86d-94a6-4c44-9b29-62762bd156d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:23.306770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562d86d-94a6-4c44-9b29-62762bd156d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:23.307801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562d86d-94a6-4c44-9b29-62762bd156d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:23.308310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562d86d-94a6-4c44-9b29-62762bd156d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:23.310134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562d86d-94a6-4c44-9b29-62762bd156d0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:23.331725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 430/864] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:23.333403 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562d86d-94a6-4c44-9b29-62762bd156d0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:23.400559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:23.409608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1f4c4-e059-47b7-aebb-16d468bf34dc None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:23.454040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fdb14-2b9b-46d1-9220-33c0b1d0f901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:23.455037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fdb14-2b9b-46d1-9220-33c0b1d0f901 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:23.455606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fdb14-2b9b-46d1-9220-33c0b1d0f901 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:23.456080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fdb14-2b9b-46d1-9220-33c0b1d0f901 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:23.457036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fdb14-2b9b-46d1-9220-33c0b1d0f901 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:23.458700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fdb14-2b9b-46d1-9220-33c0b1d0f901 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ac1fdb14-2b9b-46d1-9220-33c0b1d0f901 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:23.469519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:23.470461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 10:20:23.471382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:23.478714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562d86d-94a6-4c44-9b29-62762bd156d0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:23.479296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 435/865] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Sep 26 10:20:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:23.480423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fdb14-2b9b-46d1-9220-33c0b1d0f901 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:23.528589 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863deb6-e5c7-4979-86c4-b3c395140c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:23.529263 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863deb6-e5c7-4979-86c4-b3c395140c28 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:23.529544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863deb6-e5c7-4979-86c4-b3c395140c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:23.529821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863deb6-e5c7-4979-86c4-b3c395140c28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:23.538947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863deb6-e5c7-4979-86c4-b3c395140c28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:23.540801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863deb6-e5c7-4979-86c4-b3c395140c28 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:23.543272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b863deb6-e5c7-4979-86c4-b3c395140c28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:23.557566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:23.558478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:23.559384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:23.559384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:23.559384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:23.559384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:23.559384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:23.559384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:23.559384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:23.559384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:23.563573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 431/866] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:23.565579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863deb6-e5c7-4979-86c4-b3c395140c28 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:23.609607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fdb14-2b9b-46d1-9220-33c0b1d0f901 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:23.648224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090181f-e7ae-4b88-ac11-98daabaddcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:23.649752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090181f-e7ae-4b88-ac11-98daabaddcbd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:23.650551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090181f-e7ae-4b88-ac11-98daabaddcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:23.651112 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090181f-e7ae-4b88-ac11-98daabaddcbd None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:23.652237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090181f-e7ae-4b88-ac11-98daabaddcbd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:23.652742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090181f-e7ae-4b88-ac11-98daabaddcbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:23.654351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090181f-e7ae-4b88-ac11-98daabaddcbd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:23.660179 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 436/867] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:23.669032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090181f-e7ae-4b88-ac11-98daabaddcbd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:23.688941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863deb6-e5c7-4979-86c4-b3c395140c28 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:23.692382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:23.735606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe509c-d830-4e59-b30b-f3e41f0ac04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:23.736253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe509c-d830-4e59-b30b-f3e41f0ac04c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:23.736753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe509c-d830-4e59-b30b-f3e41f0ac04c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:23.737663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe509c-d830-4e59-b30b-f3e41f0ac04c None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:23.739150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe509c-d830-4e59-b30b-f3e41f0ac04c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:23.739469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe509c-d830-4e59-b30b-f3e41f0ac04c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:23.741200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe509c-d830-4e59-b30b-f3e41f0ac04c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:23.760769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 432/868] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:23.766590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe509c-d830-4e59-b30b-f3e41f0ac04c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:23.779906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090181f-e7ae-4b88-ac11-98daabaddcbd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:23.797850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:23.819400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de0152-c02f-4275-a204-7a7766b20f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:23.820020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de0152-c02f-4275-a204-7a7766b20f6c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:23.820354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de0152-c02f-4275-a204-7a7766b20f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:23.821306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de0152-c02f-4275-a204-7a7766b20f6c None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:23.821959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de0152-c02f-4275-a204-7a7766b20f6c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:23.822418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de0152-c02f-4275-a204-7a7766b20f6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:23.823824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de0152-c02f-4275-a204-7a7766b20f6c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:23.837587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 437/869] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:23.876199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe509c-d830-4e59-b30b-f3e41f0ac04c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:23.915396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80531e-4b33-406f-817c-408816d9c14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:23.915933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80531e-4b33-406f-817c-408816d9c14f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:23.916215 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80531e-4b33-406f-817c-408816d9c14f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:23.916489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80531e-4b33-406f-817c-408816d9c14f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:23.917248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80531e-4b33-406f-817c-408816d9c14f None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=ecdfe8d98368455db8b67097051b9e1c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:23.917560 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80531e-4b33-406f-817c-408816d9c14f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:23.918999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80531e-4b33-406f-817c-408816d9c14f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:23.933203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 433/870] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:23 2022] GET /identity/v3/role_assignments?user.id=ecdfe8d98368455db8b67097051b9e1c&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:24.644059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b2406-454a-4dd1-ab50-b66626c6b6b9 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:24.644238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b2406-454a-4dd1-ab50-b66626c6b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:24.644519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b2406-454a-4dd1-ab50-b66626c6b6b9 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:24.646126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 438/871] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:24.652284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfbbaa-15fe-476e-9a87-3f6d3d5401b3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:24.652728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfbbaa-15fe-476e-9a87-3f6d3d5401b3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:24.652804 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfbbaa-15fe-476e-9a87-3f6d3d5401b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:24.670960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1bdfbbaa-15fe-476e-9a87-3f6d3d5401b3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:24.672132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1bdfbbaa-15fe-476e-9a87-3f6d3d5401b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:24.689882 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:24.745435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 434/872] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:25.019780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b2406-454a-4dd1-ab50-b66626c6b6b9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:25.119817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85ec5d-9271-4ed5-9c15-6e67a2d70ce2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:25.120116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85ec5d-9271-4ed5-9c15-6e67a2d70ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:25.120429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85ec5d-9271-4ed5-9c15-6e67a2d70ce2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:25.121926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 435/873] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:25.126905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fd262-172f-421d-a152-cc0b42941811 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:25.127184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fd262-172f-421d-a152-cc0b42941811 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:25.127457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fd262-172f-421d-a152-cc0b42941811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:25.132515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b2406-454a-4dd1-ab50-b66626c6b6b9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:25.145657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-734fd262-172f-421d-a152-cc0b42941811 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:25.146933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-734fd262-172f-421d-a152-cc0b42941811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:25.170639 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e4cd8-c2b4-4316-8880-7e9e8301af3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:25.171273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e4cd8-c2b4-4316-8880-7e9e8301af3c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:25.171555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e4cd8-c2b4-4316-8880-7e9e8301af3c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:25.171826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e4cd8-c2b4-4316-8880-7e9e8301af3c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:25.172413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e4cd8-c2b4-4316-8880-7e9e8301af3c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:25.173808 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e4cd8-c2b4-4316-8880-7e9e8301af3c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f94e4cd8-c2b4-4316-8880-7e9e8301af3c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:25.183734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:25.185063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:25.186148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 439/874] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:25.192913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e4cd8-c2b4-4316-8880-7e9e8301af3c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:25.249149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 436/875] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:20:25.249478 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:25.306869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e4cd8-c2b4-4316-8880-7e9e8301af3c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:25.344361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec83f-8841-4619-bd28-5c3839eefc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:25.344997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec83f-8841-4619-bd28-5c3839eefc03 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:25.345288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec83f-8841-4619-bd28-5c3839eefc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:25.345566 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec83f-8841-4619-bd28-5c3839eefc03 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:25.346198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceec83f-8841-4619-bd28-5c3839eefc03 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:25.346504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceec83f-8841-4619-bd28-5c3839eefc03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:25.347916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceec83f-8841-4619-bd28-5c3839eefc03 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:25.353034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 440/876] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 10:20:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:25.358204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fd262-172f-421d-a152-cc0b42941811 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:25.447518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:25.468211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fd262-172f-421d-a152-cc0b42941811 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:25.506885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e505708-6342-4938-99c8-f58c93614eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:25.507493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505708-6342-4938-99c8-f58c93614eba None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:25.507771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505708-6342-4938-99c8-f58c93614eba None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:25.508065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505708-6342-4938-99c8-f58c93614eba None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:25.508685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e505708-6342-4938-99c8-f58c93614eba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:25.509006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e505708-6342-4938-99c8-f58c93614eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:25.510421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e505708-6342-4938-99c8-f58c93614eba None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:25.515260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 437/877] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 10:20:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:25.527699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec83f-8841-4619-bd28-5c3839eefc03 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:25.642527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec83f-8841-4619-bd28-5c3839eefc03 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:25.653406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:25.682224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d6b17-629b-4cfb-b8e7-b44fb244c3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:25.682849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d6b17-629b-4cfb-b8e7-b44fb244c3d9 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:25.683134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d6b17-629b-4cfb-b8e7-b44fb244c3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:25.683411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d6b17-629b-4cfb-b8e7-b44fb244c3d9 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:25.684076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d6b17-629b-4cfb-b8e7-b44fb244c3d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:25.685482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d6b17-629b-4cfb-b8e7-b44fb244c3d9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:25.703349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 441/878] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:20:25 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:20:26.058606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d525ba1-c516-464f-a600-6fd1230fe06a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:26.059099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d525ba1-c516-464f-a600-6fd1230fe06a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:26.059099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d525ba1-c516-464f-a600-6fd1230fe06a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:26.060653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 438/879] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:26.065831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4463f2f-53b4-4b12-ba5b-af1c13749719 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:26.066249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4463f2f-53b4-4b12-ba5b-af1c13749719 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:26.066398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4463f2f-53b4-4b12-ba5b-af1c13749719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:26.084988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f4463f2f-53b4-4b12-ba5b-af1c13749719 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:26.086688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f4463f2f-53b4-4b12-ba5b-af1c13749719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:26.161245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 442/880] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:26.328214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3571e94-f6fb-4d1b-aec4-d2f65b3cc6d6 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:26.328526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3571e94-f6fb-4d1b-aec4-d2f65b3cc6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:26.328765 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3571e94-f6fb-4d1b-aec4-d2f65b3cc6d6 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:26.330411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 439/881] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:26.336010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca634-8205-413f-aa50-9a2506630e2a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:26.336586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca634-8205-413f-aa50-9a2506630e2a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:26.337103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca634-8205-413f-aa50-9a2506630e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:26.356226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-36dca634-8205-413f-aa50-9a2506630e2a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:26.357820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-36dca634-8205-413f-aa50-9a2506630e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:26.431064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 443/882] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:26.451618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3571e94-f6fb-4d1b-aec4-d2f65b3cc6d6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:26.556343 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3571e94-f6fb-4d1b-aec4-d2f65b3cc6d6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:26.590931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af9cad-16a7-4b3c-b56c-44bf8c085ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:26.591748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af9cad-16a7-4b3c-b56c-44bf8c085ed7 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:26.592185 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af9cad-16a7-4b3c-b56c-44bf8c085ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:26.592605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af9cad-16a7-4b3c-b56c-44bf8c085ed7 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:26.593519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af9cad-16a7-4b3c-b56c-44bf8c085ed7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:26.595100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af9cad-16a7-4b3c-b56c-44bf8c085ed7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:26.614963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 440/883] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:20:26 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:26.729667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dca634-8205-413f-aa50-9a2506630e2a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:26.758224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:26.838321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dca634-8205-413f-aa50-9a2506630e2a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:26.878469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb203-ddd0-433c-8bb3-a02b2ffca2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:26.879075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb203-ddd0-433c-8bb3-a02b2ffca2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:26.879360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb203-ddd0-433c-8bb3-a02b2ffca2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:26.879627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb203-ddd0-433c-8bb3-a02b2ffca2e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:26.889922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddb203-ddd0-433c-8bb3-a02b2ffca2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-5cddb203-ddd0-433c-8bb3-a02b2ffca2e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:26.894676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:26.895584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:26.896457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 444/884] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 10:20:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:26.902557 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af9cad-16a7-4b3c-b56c-44bf8c085ed7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:26.911444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:27.010824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af9cad-16a7-4b3c-b56c-44bf8c085ed7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:27.046139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3009a-7d60-4fa7-841b-7ef07b62d87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:27.046746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3009a-7d60-4fa7-841b-7ef07b62d87c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:27.047023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3009a-7d60-4fa7-841b-7ef07b62d87c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:27.047291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3009a-7d60-4fa7-841b-7ef07b62d87c None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:27.049264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3009a-7d60-4fa7-841b-7ef07b62d87c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:27.049573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3009a-7d60-4fa7-841b-7ef07b62d87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:27.050951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3009a-7d60-4fa7-841b-7ef07b62d87c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:27.059457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 441/885] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 10:20:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:27.065039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb203-ddd0-433c-8bb3-a02b2ffca2e2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:27.153393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:27.173408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb203-ddd0-433c-8bb3-a02b2ffca2e2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:27.208083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9aea3-0f6f-4dcb-810b-60772b46b42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:27.208715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9aea3-0f6f-4dcb-810b-60772b46b42e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:27.209018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9aea3-0f6f-4dcb-810b-60772b46b42e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:27.209298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9aea3-0f6f-4dcb-810b-60772b46b42e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:27.219458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9aea3-0f6f-4dcb-810b-60772b46b42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:27.221019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9aea3-0f6f-4dcb-810b-60772b46b42e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f8d9aea3-0f6f-4dcb-810b-60772b46b42e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:27.236347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:27.237324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:27.238290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:27.238290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:27.238290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:27.238290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 445/886] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:27.245441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3009a-7d60-4fa7-841b-7ef07b62d87c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:27.316529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:27.356337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3009a-7d60-4fa7-841b-7ef07b62d87c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:27.393545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63f9f2-7b9e-4307-a3a3-0ea9b0b86751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:27.394151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f9f2-7b9e-4307-a3a3-0ea9b0b86751 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:27.394432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f9f2-7b9e-4307-a3a3-0ea9b0b86751 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:27.394701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f9f2-7b9e-4307-a3a3-0ea9b0b86751 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:27.395338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63f9f2-7b9e-4307-a3a3-0ea9b0b86751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:27.395691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63f9f2-7b9e-4307-a3a3-0ea9b0b86751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:27.397088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63f9f2-7b9e-4307-a3a3-0ea9b0b86751 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:27.416321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9aea3-0f6f-4dcb-810b-60772b46b42e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:27.417099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 442/887] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:27.520571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9aea3-0f6f-4dcb-810b-60772b46b42e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:27.551222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:27.557591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d1ccd-a7d4-422d-a7a2-f22cf54924c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:27.558403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d1ccd-a7d4-422d-a7a2-f22cf54924c6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:27.558913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d1ccd-a7d4-422d-a7a2-f22cf54924c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:27.559230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d1ccd-a7d4-422d-a7a2-f22cf54924c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:27.568192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d1ccd-a7d4-422d-a7a2-f22cf54924c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:27.569760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d1ccd-a7d4-422d-a7a2-f22cf54924c6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-908d1ccd-a7d4-422d-a7a2-f22cf54924c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:27.582814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:27.583833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:27.584765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 446/888] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 10:20:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:27.590474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63f9f2-7b9e-4307-a3a3-0ea9b0b86751 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:27.701337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63f9f2-7b9e-4307-a3a3-0ea9b0b86751 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:27.729316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:27.731287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b0804-e470-49e7-b198-31c00e6d3964 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:27.731601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b0804-e470-49e7-b198-31c00e6d3964 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:27.731871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b0804-e470-49e7-b198-31c00e6d3964 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:27.733394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 447/889] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:27.738593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8153f12-6ca5-4377-8aad-a461b7591225 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:27.739025 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8153f12-6ca5-4377-8aad-a461b7591225 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:27.739358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8153f12-6ca5-4377-8aad-a461b7591225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:27.745650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2303690-e8c3-45da-b66d-2813e3691f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:27.746253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2303690-e8c3-45da-b66d-2813e3691f58 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:27.746531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2303690-e8c3-45da-b66d-2813e3691f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:27.746802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2303690-e8c3-45da-b66d-2813e3691f58 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:27.747533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2303690-e8c3-45da-b66d-2813e3691f58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:27.747838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2303690-e8c3-45da-b66d-2813e3691f58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:27.749396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2303690-e8c3-45da-b66d-2813e3691f58 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:27.761235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f8153f12-6ca5-4377-8aad-a461b7591225 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:27.762408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f8153f12-6ca5-4377-8aad-a461b7591225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:27.767749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 443/890] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 10:20:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:27.774479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2303690-e8c3-45da-b66d-2813e3691f58 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:27.850277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 448/891] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:27.889615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2303690-e8c3-45da-b66d-2813e3691f58 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:27.926985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bd4f9-36e2-4442-9077-df9f3839f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:27.928000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bd4f9-36e2-4442-9077-df9f3839f923 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:27.928544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bd4f9-36e2-4442-9077-df9f3839f923 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:27.929058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bd4f9-36e2-4442-9077-df9f3839f923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:27.977862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927afb3-c93b-46e6-9d35-1c8952abd84f None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:27.978060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927afb3-c93b-46e6-9d35-1c8952abd84f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:27.978344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927afb3-c93b-46e6-9d35-1c8952abd84f None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:27.979897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 449/892] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:20:27.984976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9178-a00d-4bac-ba57-7923d3b31e92 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:27.985267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9178-a00d-4bac-ba57-7923d3b31e92 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:27.985545 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9178-a00d-4bac-ba57-7923d3b31e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:27.989497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:28.005080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-793e9178-a00d-4bac-ba57-7923d3b31e92 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:28.006334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-793e9178-a00d-4bac-ba57-7923d3b31e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:28.007017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bd4f9-36e2-4442-9077-df9f3839f923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:28.009520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bd4f9-36e2-4442-9077-df9f3839f923 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:28.089025 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 450/893] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:28.119995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9178-a00d-4bac-ba57-7923d3b31e92 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:28.138752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 444/894] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:27 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:20:28.146934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bd4f9-36e2-4442-9077-df9f3839f923 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:28.194619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:28.241649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:28.261202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9178-a00d-4bac-ba57-7923d3b31e92 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:28.261792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bd4f9-36e2-4442-9077-df9f3839f923 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:28.298395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2a8ee-9b08-4699-b43d-80cb08e87cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:28.299412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2a8ee-9b08-4699-b43d-80cb08e87cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:28.299682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2a8ee-9b08-4699-b43d-80cb08e87cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:28.300048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2a8ee-9b08-4699-b43d-80cb08e87cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:28.305766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d172-c0c0-4f3d-8e25-3d7d4dbfaf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:28.306543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d172-c0c0-4f3d-8e25-3d7d4dbfaf33 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:28.306970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d172-c0c0-4f3d-8e25-3d7d4dbfaf33 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:28.307408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d172-c0c0-4f3d-8e25-3d7d4dbfaf33 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:28.308739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d172-c0c0-4f3d-8e25-3d7d4dbfaf33 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:28.310753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d172-c0c0-4f3d-8e25-3d7d4dbfaf33 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:28.312327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2a8ee-9b08-4699-b43d-80cb08e87cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:28.313868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2a8ee-9b08-4699-b43d-80cb08e87cb7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-bbf2a8ee-9b08-4699-b43d-80cb08e87cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:28.332444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:28.333700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:28.334846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:28.334846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:28.334846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:28.340533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 445/895] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:28.341244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 451/896] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:20:28 2022] POST /identity/v3/services => generated 241 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:20:28.346020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2a8ee-9b08-4699-b43d-80cb08e87cb7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:28.359812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d172-c0c0-4f3d-8e25-3d7d4dbfaf33 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:28.472837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2a8ee-9b08-4699-b43d-80cb08e87cb7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:28.520314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cad304-e294-4aa3-ab29-107a47cb094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:28.521192 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cad304-e294-4aa3-ab29-107a47cb094c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:28.521642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cad304-e294-4aa3-ab29-107a47cb094c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:28.522057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cad304-e294-4aa3-ab29-107a47cb094c None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:28.522921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cad304-e294-4aa3-ab29-107a47cb094c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:28.523359 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cad304-e294-4aa3-ab29-107a47cb094c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:28.524735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d172-c0c0-4f3d-8e25-3d7d4dbfaf33 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:28.525575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cad304-e294-4aa3-ab29-107a47cb094c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:28.527654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:28.540191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:28.547432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 446/897] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:28.551554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cad304-e294-4aa3-ab29-107a47cb094c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:28.577825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844d49-5f68-49a7-beaa-87bfbb06f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:28.578579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844d49-5f68-49a7-beaa-87bfbb06f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:28.578858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844d49-5f68-49a7-beaa-87bfbb06f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:28.579126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27844d49-5f68-49a7-beaa-87bfbb06f3c5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:28.579909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27844d49-5f68-49a7-beaa-87bfbb06f3c5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:28.581726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27844d49-5f68-49a7-beaa-87bfbb06f3c5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-27844d49-5f68-49a7-beaa-87bfbb06f3c5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:28.591293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:28.592298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:28.593295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 452/898] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:20:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:28.598324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844d49-5f68-49a7-beaa-87bfbb06f3c5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:28.673571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cad304-e294-4aa3-ab29-107a47cb094c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:28.709261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27844d49-5f68-49a7-beaa-87bfbb06f3c5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:28.710253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fde0e-4e8f-4d98-be0b-023b140732b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:28.711084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fde0e-4e8f-4d98-be0b-023b140732b4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:28.712108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fde0e-4e8f-4d98-be0b-023b140732b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:28.712447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fde0e-4e8f-4d98-be0b-023b140732b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:28.719610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fde0e-4e8f-4d98-be0b-023b140732b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:28.721277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fde0e-4e8f-4d98-be0b-023b140732b4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5f1fde0e-4e8f-4d98-be0b-023b140732b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:28.733362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:28.734282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:28.735151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:28.735151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:28.735151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:28.735151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:28.735151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:28.735151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:28.735151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:28.735151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:28.735151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 447/899] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:28.741439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fde0e-4e8f-4d98-be0b-023b140732b4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:28.745180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40332a95-fd0e-499c-a082-aa573009b645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:28.745794 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40332a95-fd0e-499c-a082-aa573009b645 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:28.746074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40332a95-fd0e-499c-a082-aa573009b645 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:28.746351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40332a95-fd0e-499c-a082-aa573009b645 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:28.746982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40332a95-fd0e-499c-a082-aa573009b645 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:28.747287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40332a95-fd0e-499c-a082-aa573009b645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:28.748641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40332a95-fd0e-499c-a082-aa573009b645 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:28.754136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 453/900] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:20:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:28.759867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40332a95-fd0e-499c-a082-aa573009b645 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:28.802710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:28.823204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:28.877163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fde0e-4e8f-4d98-be0b-023b140732b4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:28.890970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40332a95-fd0e-499c-a082-aa573009b645 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:28.914603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db89da4-6d4f-41d1-a09b-9a4a193dc0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:28.915247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db89da4-6d4f-41d1-a09b-9a4a193dc0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:28.915526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db89da4-6d4f-41d1-a09b-9a4a193dc0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:28.915796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db89da4-6d4f-41d1-a09b-9a4a193dc0d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:28.916480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db89da4-6d4f-41d1-a09b-9a4a193dc0d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:28.916782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db89da4-6d4f-41d1-a09b-9a4a193dc0d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:28.918226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db89da4-6d4f-41d1-a09b-9a4a193dc0d2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:28.931171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 448/901] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:28.936753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db89da4-6d4f-41d1-a09b-9a4a193dc0d2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:28.940289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e743a3-c003-4ccc-8c35-8b1e8e2752da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:28.941268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e743a3-c003-4ccc-8c35-8b1e8e2752da None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:28.941749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e743a3-c003-4ccc-8c35-8b1e8e2752da None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:28.942257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e743a3-c003-4ccc-8c35-8b1e8e2752da None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:28.943085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e743a3-c003-4ccc-8c35-8b1e8e2752da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:28.943584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e743a3-c003-4ccc-8c35-8b1e8e2752da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:28.945586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e743a3-c003-4ccc-8c35-8b1e8e2752da None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:28.955551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 454/902] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:20:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:28.955551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a32a-d006-4ade-ac02-99031c9ac281 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:28.955551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a32a-d006-4ade-ac02-99031c9ac281 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:28.955849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15a32a-d006-4ade-ac02-99031c9ac281 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:28.957592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 455/903] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:28.958166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15a32a-d006-4ade-ac02-99031c9ac281 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:29.046286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db89da4-6d4f-41d1-a09b-9a4a193dc0d2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:29.062356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:29.070398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:29.075951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15a32a-d006-4ade-ac02-99031c9ac281 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:29.086877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bc463-cf6d-49c4-81ee-7f8ecef8fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:29.087797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bc463-cf6d-49c4-81ee-7f8ecef8fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:29.088258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bc463-cf6d-49c4-81ee-7f8ecef8fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:29.088502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bc463-cf6d-49c4-81ee-7f8ecef8fcf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:29.089245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bc463-cf6d-49c4-81ee-7f8ecef8fcf0 None admin] RBAC: Adding query filter params (role.id=7b5b4b92aecb413e92b114c40fdff615, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=ecdfe8d98368455db8b67097051b9e1c) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:29.089657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bc463-cf6d-49c4-81ee-7f8ecef8fcf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:29.090978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bc463-cf6d-49c4-81ee-7f8ecef8fcf0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:29.104980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 449/904] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:28 2022] GET /identity/v3/role_assignments?user.id=ecdfe8d98368455db8b67097051b9e1c&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=7b5b4b92aecb413e92b114c40fdff615 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:29.104980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f69a-5a72-4c41-8fb4-2543f19797d5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:29.104980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f69a-5a72-4c41-8fb4-2543f19797d5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:29.104980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f69a-5a72-4c41-8fb4-2543f19797d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:29.119796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-46e5f69a-5a72-4c41-8fb4-2543f19797d5 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:29.121153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-46e5f69a-5a72-4c41-8fb4-2543f19797d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:29.121971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69955be7-821a-43e5-89bb-26bb441efd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:29.122612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69955be7-821a-43e5-89bb-26bb441efd9b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:29.122894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69955be7-821a-43e5-89bb-26bb441efd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:29.123171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69955be7-821a-43e5-89bb-26bb441efd9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:29.123894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69955be7-821a-43e5-89bb-26bb441efd9b None admin] RBAC: Adding query filter params (interface=public, service_id=8d92e3a086654e6994f4ffeddaf8fedd, region_id=RegionOne) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:29.124209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69955be7-821a-43e5-89bb-26bb441efd9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:29.125630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69955be7-821a-43e5-89bb-26bb441efd9b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:29.131867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 456/905] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 10:20:28 2022] GET /identity/v3/endpoints?service_id=8d92e3a086654e6994f4ffeddaf8fedd&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:29.137502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69955be7-821a-43e5-89bb-26bb441efd9b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:29.206135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 450/906] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:29.261873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69955be7-821a-43e5-89bb-26bb441efd9b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:29.302234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f62dff-1a68-4fbf-b3b4-40e39795ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:29.302877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f62dff-1a68-4fbf-b3b4-40e39795ee85 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:29.303164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f62dff-1a68-4fbf-b3b4-40e39795ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:29.303501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f62dff-1a68-4fbf-b3b4-40e39795ee85 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:29.304139 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f62dff-1a68-4fbf-b3b4-40e39795ee85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:29.306149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f62dff-1a68-4fbf-b3b4-40e39795ee85 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:29.313868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 457/907] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 10:20:29 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:20:29.477914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f69a-5a72-4c41-8fb4-2543f19797d5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:29.589331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f69a-5a72-4c41-8fb4-2543f19797d5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:29.599485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:29.626326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860058f7-142d-4717-8bb5-05d910afda85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:29.626964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860058f7-142d-4717-8bb5-05d910afda85 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:29.627303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860058f7-142d-4717-8bb5-05d910afda85 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:29.627583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860058f7-142d-4717-8bb5-05d910afda85 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:29.628171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860058f7-142d-4717-8bb5-05d910afda85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:29.629578 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860058f7-142d-4717-8bb5-05d910afda85 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-860058f7-142d-4717-8bb5-05d910afda85 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:29.639355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:29.640280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:29.641175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 451/908] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Sep 26 10:20:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:29.646451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f62dff-1a68-4fbf-b3b4-40e39795ee85 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:29.677103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:29.752906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f62dff-1a68-4fbf-b3b4-40e39795ee85 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:29.793580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4f4a5-5b4e-4357-a767-19e5eca02ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:29.794190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4f4a5-5b4e-4357-a767-19e5eca02ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:29.794466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4f4a5-5b4e-4357-a767-19e5eca02ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:29.794737 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4f4a5-5b4e-4357-a767-19e5eca02ed4 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:29.795359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4f4a5-5b4e-4357-a767-19e5eca02ed4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:29.795661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4f4a5-5b4e-4357-a767-19e5eca02ed4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:29.797058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4f4a5-5b4e-4357-a767-19e5eca02ed4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:29.802097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 458/909] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:29.808094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860058f7-142d-4717-8bb5-05d910afda85 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:29.916661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860058f7-142d-4717-8bb5-05d910afda85 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:29.954052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a136e-dc97-4e25-85e7-a1d2caffafad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:29.954665 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a136e-dc97-4e25-85e7-a1d2caffafad None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:29.954948 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a136e-dc97-4e25-85e7-a1d2caffafad None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:29.955220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a136e-dc97-4e25-85e7-a1d2caffafad None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:29.955845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a136e-dc97-4e25-85e7-a1d2caffafad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:29.956149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a136e-dc97-4e25-85e7-a1d2caffafad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:29.957545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a136e-dc97-4e25-85e7-a1d2caffafad None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:29.962953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 452/910] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:29.970087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4f4a5-5b4e-4357-a767-19e5eca02ed4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:30.069209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:30.080309 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4f4a5-5b4e-4357-a767-19e5eca02ed4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:30.119349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f146a-7795-4563-a8d1-c3a7c2a66f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:30.119964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f146a-7795-4563-a8d1-c3a7c2a66f40 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:30.120249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f146a-7795-4563-a8d1-c3a7c2a66f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:30.120527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f146a-7795-4563-a8d1-c3a7c2a66f40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:30.121256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f146a-7795-4563-a8d1-c3a7c2a66f40 None admin] RBAC: Adding query filter params (interface=public, service_id=5675cd7c87df42019bdbabc3209d4e51, region_id=RegionOne) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:30.121568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f146a-7795-4563-a8d1-c3a7c2a66f40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:30.122927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f146a-7795-4563-a8d1-c3a7c2a66f40 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:30.128419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 459/911] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 10:20:29 2022] GET /identity/v3/endpoints?service_id=5675cd7c87df42019bdbabc3209d4e51&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:30.134646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a136e-dc97-4e25-85e7-a1d2caffafad None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:30.172568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:30.241664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a136e-dc97-4e25-85e7-a1d2caffafad None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:30.279914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd3a05-a1f4-4b5e-bc91-0a1b15fb8e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:30.280533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3a05-a1f4-4b5e-bc91-0a1b15fb8e3e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:30.280815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3a05-a1f4-4b5e-bc91-0a1b15fb8e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:30.281121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd3a05-a1f4-4b5e-bc91-0a1b15fb8e3e None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:30.281731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd3a05-a1f4-4b5e-bc91-0a1b15fb8e3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:30.283145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd3a05-a1f4-4b5e-bc91-0a1b15fb8e3e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:30.290190 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 453/912] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 10:20:30 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:20:30.700600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9bb6e-8468-4c51-868f-565dcf63c1c9 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:30.701166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9bb6e-8468-4c51-868f-565dcf63c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:30.701166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9bb6e-8468-4c51-868f-565dcf63c1c9 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:30.702826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 460/913] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:30.708198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd9843-ac2c-4cb4-a71e-2ad7f8ef77d5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:30.708486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd9843-ac2c-4cb4-a71e-2ad7f8ef77d5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:30.708761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd9843-ac2c-4cb4-a71e-2ad7f8ef77d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:30.727705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-29dd9843-ac2c-4cb4-a71e-2ad7f8ef77d5 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:30.728900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-29dd9843-ac2c-4cb4-a71e-2ad7f8ef77d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:30.805060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 454/914] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:31.078636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9bb6e-8468-4c51-868f-565dcf63c1c9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:31.190631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9bb6e-8468-4c51-868f-565dcf63c1c9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:31.235501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad49d96-0467-44a2-93e1-a270fecf93fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:31.236161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49d96-0467-44a2-93e1-a270fecf93fa None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:31.236445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49d96-0467-44a2-93e1-a270fecf93fa None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:31.236720 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49d96-0467-44a2-93e1-a270fecf93fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:31.237354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad49d96-0467-44a2-93e1-a270fecf93fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:31.238744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad49d96-0467-44a2-93e1-a270fecf93fa None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-0ad49d96-0467-44a2-93e1-a270fecf93fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:31.248537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:31.249577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:31.250393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:31.254177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 461/915] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:31.256048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd9843-ac2c-4cb4-a71e-2ad7f8ef77d5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:31.286607 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:31.331138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f300d2-a192-4d47-8cfd-46198fb93029 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:31.331442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f300d2-a192-4d47-8cfd-46198fb93029 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:31.331669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f300d2-a192-4d47-8cfd-46198fb93029 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:31.334306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 462/916] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:20:31.340038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281c17-23c7-47eb-b1d7-9853fd3eb5d4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:31.340324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281c17-23c7-47eb-b1d7-9853fd3eb5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:31.340991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281c17-23c7-47eb-b1d7-9853fd3eb5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:31.361907 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6f281c17-23c7-47eb-b1d7-9853fd3eb5d4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:31.363111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6f281c17-23c7-47eb-b1d7-9853fd3eb5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:31.375528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd9843-ac2c-4cb4-a71e-2ad7f8ef77d5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:31.397341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:31.411828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f546f0-1e9c-4247-a30e-2bc8c41f3c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:31.412756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f546f0-1e9c-4247-a30e-2bc8c41f3c18 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:31.413261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f546f0-1e9c-4247-a30e-2bc8c41f3c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:31.413756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f546f0-1e9c-4247-a30e-2bc8c41f3c18 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:31.414664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f546f0-1e9c-4247-a30e-2bc8c41f3c18 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:31.415202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f546f0-1e9c-4247-a30e-2bc8c41f3c18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:31.416813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f546f0-1e9c-4247-a30e-2bc8c41f3c18 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:31.422327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 455/917] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 10:20:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:31.427959 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f546f0-1e9c-4247-a30e-2bc8c41f3c18 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:31.448982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 463/918] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:31.551250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:31.561059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f546f0-1e9c-4247-a30e-2bc8c41f3c18 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:31.599304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e299384-14dd-469c-b811-41fb26ff2a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:31.599826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e299384-14dd-469c-b811-41fb26ff2a4c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:31.600155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e299384-14dd-469c-b811-41fb26ff2a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:31.600434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e299384-14dd-469c-b811-41fb26ff2a4c None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:31.601116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e299384-14dd-469c-b811-41fb26ff2a4c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:31.601424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e299384-14dd-469c-b811-41fb26ff2a4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:31.602828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e299384-14dd-469c-b811-41fb26ff2a4c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:31.608211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 456/919] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 10:20:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:31.614649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f281c17-23c7-47eb-b1d7-9853fd3eb5d4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:31.661360 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c413829-fc5c-4d51-8477-2377a370141f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:31.661763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c413829-fc5c-4d51-8477-2377a370141f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:31.661937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c413829-fc5c-4d51-8477-2377a370141f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:31.663439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 457/920] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:31.668400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e0ca1-c209-44bd-9162-d7b8d8d91141 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:31.668552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e0ca1-c209-44bd-9162-d7b8d8d91141 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:31.668791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e0ca1-c209-44bd-9162-d7b8d8d91141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:31.690276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c07e0ca1-c209-44bd-9162-d7b8d8d91141 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:31.691469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c07e0ca1-c209-44bd-9162-d7b8d8d91141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:31.725771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f281c17-23c7-47eb-b1d7-9853fd3eb5d4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:31.761508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712a45d-d6e0-4754-9ae8-51db26e850f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:31.762115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712a45d-d6e0-4754-9ae8-51db26e850f4 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:31.762401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712a45d-d6e0-4754-9ae8-51db26e850f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:31.762674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712a45d-d6e0-4754-9ae8-51db26e850f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:31.763473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712a45d-d6e0-4754-9ae8-51db26e850f4 None admin] RBAC: Adding query filter params (interface=public, service_id=e927b786befa4c429934766af1a9ac28, region_id=RegionOne) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:31.763791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712a45d-d6e0-4754-9ae8-51db26e850f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:31.765341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712a45d-d6e0-4754-9ae8-51db26e850f4 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:31.770581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 464/921] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 10:20:31 2022] GET /identity/v3/endpoints?service_id=e927b786befa4c429934766af1a9ac28&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:31.771349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712a45d-d6e0-4754-9ae8-51db26e850f4 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:31.774442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 458/922] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:20:31.778163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e0ca1-c209-44bd-9162-d7b8d8d91141 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:31.794906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:31.874662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:31.889558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712a45d-d6e0-4754-9ae8-51db26e850f4 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:31.894870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e0ca1-c209-44bd-9162-d7b8d8d91141 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:31.927833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43d5c1-c154-4eaa-bc0c-b27a6a682898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:31.928843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d5c1-c154-4eaa-bc0c-b27a6a682898 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:31.929345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d5c1-c154-4eaa-bc0c-b27a6a682898 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:31.930300 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d5c1-c154-4eaa-bc0c-b27a6a682898 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:31.937416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8746f-4ffc-4a23-ad6f-fc40a1d19a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:31.938037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8746f-4ffc-4a23-ad6f-fc40a1d19a7d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:31.938298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8746f-4ffc-4a23-ad6f-fc40a1d19a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:31.938570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8746f-4ffc-4a23-ad6f-fc40a1d19a7d None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:31.939172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8746f-4ffc-4a23-ad6f-fc40a1d19a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:31.940802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8746f-4ffc-4a23-ad6f-fc40a1d19a7d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:31.944204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43d5c1-c154-4eaa-bc0c-b27a6a682898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-df43d5c1-c154-4eaa-bc0c-b27a6a682898 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:31.949920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:31.950859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:31.951689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:31.953393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 459/923] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 10:20:31 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:20:31.954491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 465/924] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 10:20:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:31.965097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8746f-4ffc-4a23-ad6f-fc40a1d19a7d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:32.056929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43d5c1-c154-4eaa-bc0c-b27a6a682898 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:32.084251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8746f-4ffc-4a23-ad6f-fc40a1d19a7d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:32.129937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce614c6-e6bf-4531-906b-9ac96151bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:32.131084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce614c6-e6bf-4531-906b-9ac96151bda1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.131914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce614c6-e6bf-4531-906b-9ac96151bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.132640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce614c6-e6bf-4531-906b-9ac96151bda1 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.133653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce614c6-e6bf-4531-906b-9ac96151bda1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:32.134199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce614c6-e6bf-4531-906b-9ac96151bda1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:32.136015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce614c6-e6bf-4531-906b-9ac96151bda1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:32.149105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 460/925] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 10:20:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:32.156093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:32.156247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce614c6-e6bf-4531-906b-9ac96151bda1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:32.176158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:32.190631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43d5c1-c154-4eaa-bc0c-b27a6a682898 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:32.235929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d82f95-85f1-4732-9c61-77ae0dcb7da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:32.236998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d82f95-85f1-4732-9c61-77ae0dcb7da5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.237560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d82f95-85f1-4732-9c61-77ae0dcb7da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.237842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d82f95-85f1-4732-9c61-77ae0dcb7da5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.238436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d82f95-85f1-4732-9c61-77ae0dcb7da5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:32.239824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d82f95-85f1-4732-9c61-77ae0dcb7da5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a9d82f95-85f1-4732-9c61-77ae0dcb7da5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:32.251055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:32.252298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:32.253178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 466/926] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:20:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:32.260433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d82f95-85f1-4732-9c61-77ae0dcb7da5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:32.284488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce614c6-e6bf-4531-906b-9ac96151bda1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:32.321766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d40d-35c1-4541-ac10-9adc7b651a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:32.322679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d40d-35c1-4541-ac10-9adc7b651a28 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.323230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d40d-35c1-4541-ac10-9adc7b651a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.323652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d40d-35c1-4541-ac10-9adc7b651a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.335260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d40d-35c1-4541-ac10-9adc7b651a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:32.336934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d40d-35c1-4541-ac10-9adc7b651a28 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a805d40d-35c1-4541-ac10-9adc7b651a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:32.352850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:32.353854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:32.354740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:32.354740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:32.354740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:32.361259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 461/927] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:32.362687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d40d-35c1-4541-ac10-9adc7b651a28 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:32.390308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d82f95-85f1-4732-9c61-77ae0dcb7da5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:32.439786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3c432-ec41-46ea-98d2-9d6b42731558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:32.440787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3c432-ec41-46ea-98d2-9d6b42731558 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.441292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3c432-ec41-46ea-98d2-9d6b42731558 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.441776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3c432-ec41-46ea-98d2-9d6b42731558 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.442595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3c432-ec41-46ea-98d2-9d6b42731558 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:32.443123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3c432-ec41-46ea-98d2-9d6b42731558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:32.444668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3c432-ec41-46ea-98d2-9d6b42731558 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:32.450180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 467/928] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:20:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:32.457182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3c432-ec41-46ea-98d2-9d6b42731558 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:32.457701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:32.459132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:32.507141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d40d-35c1-4541-ac10-9adc7b651a28 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:32.549161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd8439-3d81-4134-920b-58fab657759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:32.549766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd8439-3d81-4134-920b-58fab657759d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.550045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd8439-3d81-4134-920b-58fab657759d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.550318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd8439-3d81-4134-920b-58fab657759d None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.550957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd8439-3d81-4134-920b-58fab657759d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:32.551254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd8439-3d81-4134-920b-58fab657759d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:32.552621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd8439-3d81-4134-920b-58fab657759d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:32.569587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 462/929] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:32.569587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abf27-6075-457d-8298-c1462ef7cbc7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.569587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abf27-6075-457d-8298-c1462ef7cbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.569587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64abf27-6075-457d-8298-c1462ef7cbc7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.569587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 463/930] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:32.570480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64abf27-6075-457d-8298-c1462ef7cbc7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:32.580546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3c432-ec41-46ea-98d2-9d6b42731558 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:32.615980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00d2f7-38ae-4506-a3bd-1b7b49e5ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:32.616711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d2f7-38ae-4506-a3bd-1b7b49e5ed88 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.617011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d2f7-38ae-4506-a3bd-1b7b49e5ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.617318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d2f7-38ae-4506-a3bd-1b7b49e5ed88 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.618062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00d2f7-38ae-4506-a3bd-1b7b49e5ed88 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:32.618371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00d2f7-38ae-4506-a3bd-1b7b49e5ed88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:32.619722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00d2f7-38ae-4506-a3bd-1b7b49e5ed88 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:32.629860 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 468/931] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 10:20:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:32.631151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bb1bf-9b00-475e-b82b-5abab5369233 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.631445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bb1bf-9b00-475e-b82b-5abab5369233 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.631721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bb1bf-9b00-475e-b82b-5abab5369233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.650750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-925bb1bf-9b00-475e-b82b-5abab5369233 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:32.652228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-925bb1bf-9b00-475e-b82b-5abab5369233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:32.675143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64abf27-6075-457d-8298-c1462ef7cbc7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:32.699812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:32.708924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed32a-3a78-4496-a05f-c933d558e96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:32.709593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed32a-3a78-4496-a05f-c933d558e96b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.709878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed32a-3a78-4496-a05f-c933d558e96b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.710144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed32a-3a78-4496-a05f-c933d558e96b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.717397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:32.718358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ed32a-3a78-4496-a05f-c933d558e96b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:32.720006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ed32a-3a78-4496-a05f-c933d558e96b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:32.728038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 469/932] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5b8ed32a-3a78-4496-a05f-c933d558e96b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:32.734011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:32.734910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:32.735838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:32.735838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:32.735838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:32.735838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:32.735838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:32.735838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:32.735838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:32.735838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:32.735838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:32.735838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:32.737321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 464/933] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 10:20:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:32.741172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bb1bf-9b00-475e-b82b-5abab5369233 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:32.741323 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed32a-3a78-4496-a05f-c933d558e96b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:32.857086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bb1bf-9b00-475e-b82b-5abab5369233 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:32.874742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed32a-3a78-4496-a05f-c933d558e96b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:32.903978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7223924-a696-4e1f-9d51-4c0c663fac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:32.905228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7223924-a696-4e1f-9d51-4c0c663fac11 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.905833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7223924-a696-4e1f-9d51-4c0c663fac11 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.906304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7223924-a696-4e1f-9d51-4c0c663fac11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.907211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7223924-a696-4e1f-9d51-4c0c663fac11 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:32.908787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7223924-a696-4e1f-9d51-4c0c663fac11 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:32.911415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9e5f8-20df-4363-8df6-5df22de2072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:32.912130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9e5f8-20df-4363-8df6-5df22de2072f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:32.912530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9e5f8-20df-4363-8df6-5df22de2072f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:32.913019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9e5f8-20df-4363-8df6-5df22de2072f None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:32.913854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9e5f8-20df-4363-8df6-5df22de2072f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:32.914372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9e5f8-20df-4363-8df6-5df22de2072f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:32.915998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9e5f8-20df-4363-8df6-5df22de2072f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:32.935410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 470/934] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:20:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:32.937441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 465/935] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 10:20:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:32.947008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7223924-a696-4e1f-9d51-4c0c663fac11 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:33.008063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:33.023070 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9e5f8-20df-4363-8df6-5df22de2072f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:33.081254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7223924-a696-4e1f-9d51-4c0c663fac11 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:33.087364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:33.125045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605832a2-001e-4109-a3b6-3a345d810cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:33.125682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605832a2-001e-4109-a3b6-3a345d810cec None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:33.125960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605832a2-001e-4109-a3b6-3a345d810cec None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:33.126229 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605832a2-001e-4109-a3b6-3a345d810cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:33.138854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605832a2-001e-4109-a3b6-3a345d810cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:33.140297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605832a2-001e-4109-a3b6-3a345d810cec None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-605832a2-001e-4109-a3b6-3a345d810cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:33.156372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:33.157412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:33.158285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:33.158285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:33.158285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:33.158285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 471/936] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:33.158524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9e5f8-20df-4363-8df6-5df22de2072f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:33.165999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605832a2-001e-4109-a3b6-3a345d810cec None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:33.205143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793de76-6de4-4786-8389-1bf135b5c214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:33.205937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793de76-6de4-4786-8389-1bf135b5c214 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:33.206221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793de76-6de4-4786-8389-1bf135b5c214 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:33.207295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793de76-6de4-4786-8389-1bf135b5c214 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:33.207883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793de76-6de4-4786-8389-1bf135b5c214 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:33.209278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793de76-6de4-4786-8389-1bf135b5c214 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0793de76-6de4-4786-8389-1bf135b5c214 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:33.222138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:33.223097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:33.223975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 466/937] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Sep 26 10:20:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:33.229764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793de76-6de4-4786-8389-1bf135b5c214 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:33.281678 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:33.285198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605832a2-001e-4109-a3b6-3a345d810cec None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:33.323338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eed0f-c08f-4d77-9ef2-7fb202ce6089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:33.324111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eed0f-c08f-4d77-9ef2-7fb202ce6089 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:33.324484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eed0f-c08f-4d77-9ef2-7fb202ce6089 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:33.324851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eed0f-c08f-4d77-9ef2-7fb202ce6089 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:33.325618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7eed0f-c08f-4d77-9ef2-7fb202ce6089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:33.326029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7eed0f-c08f-4d77-9ef2-7fb202ce6089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:33.328022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7eed0f-c08f-4d77-9ef2-7fb202ce6089 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:33.343132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 472/938] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:33.347922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793de76-6de4-4786-8389-1bf135b5c214 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:33.348825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eed0f-c08f-4d77-9ef2-7fb202ce6089 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:33.361705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:33.399295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b30c5b-d7dc-48e9-af78-551730360adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:33.400758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b30c5b-d7dc-48e9-af78-551730360adc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:33.401285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b30c5b-d7dc-48e9-af78-551730360adc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:33.402461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b30c5b-d7dc-48e9-af78-551730360adc None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:33.403313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b30c5b-d7dc-48e9-af78-551730360adc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:33.404171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b30c5b-d7dc-48e9-af78-551730360adc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:33.406057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b30c5b-d7dc-48e9-af78-551730360adc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:33.413099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 467/939] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:33.421074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b30c5b-d7dc-48e9-af78-551730360adc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:33.471663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eed0f-c08f-4d77-9ef2-7fb202ce6089 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:33.510201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9773e-dc9c-4e18-8cf6-cddecfd0b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:33.510963 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9773e-dc9c-4e18-8cf6-cddecfd0b37b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:33.511657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9773e-dc9c-4e18-8cf6-cddecfd0b37b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:33.512001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9773e-dc9c-4e18-8cf6-cddecfd0b37b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:33.519490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9773e-dc9c-4e18-8cf6-cddecfd0b37b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:33.521303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9773e-dc9c-4e18-8cf6-cddecfd0b37b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-73d9773e-dc9c-4e18-8cf6-cddecfd0b37b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:33.537195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:33.538132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:33.539003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:33.539003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:33.539003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:33.539003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:33.539003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:33.539003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:33.539003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:33.539003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:33.543802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b30c5b-d7dc-48e9-af78-551730360adc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:33.543924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 473/940] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:33.544715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9773e-dc9c-4e18-8cf6-cddecfd0b37b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:33.570584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:33.588092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad1a8-896b-46c4-8ebe-7fd7cfe15e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:33.589064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad1a8-896b-46c4-8ebe-7fd7cfe15e67 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:33.589524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad1a8-896b-46c4-8ebe-7fd7cfe15e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:33.590019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad1a8-896b-46c4-8ebe-7fd7cfe15e67 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:33.591378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ad1a8-896b-46c4-8ebe-7fd7cfe15e67 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:33.591871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ad1a8-896b-46c4-8ebe-7fd7cfe15e67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:33.594054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ad1a8-896b-46c4-8ebe-7fd7cfe15e67 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:33.606730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 468/941] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:33.612639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad1a8-896b-46c4-8ebe-7fd7cfe15e67 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:33.652091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:33.669786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9773e-dc9c-4e18-8cf6-cddecfd0b37b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:33.716584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7e1c-1fdb-4718-8eb7-21a4c2c3fdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:33.717398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7e1c-1fdb-4718-8eb7-21a4c2c3fdc2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:33.717788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7e1c-1fdb-4718-8eb7-21a4c2c3fdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:33.718154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7e1c-1fdb-4718-8eb7-21a4c2c3fdc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:33.718939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd7e1c-1fdb-4718-8eb7-21a4c2c3fdc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:33.719340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd7e1c-1fdb-4718-8eb7-21a4c2c3fdc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:33.721565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd7e1c-1fdb-4718-8eb7-21a4c2c3fdc2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:33.732836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad1a8-896b-46c4-8ebe-7fd7cfe15e67 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:33.744090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 474/942] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:33.745213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7e1c-1fdb-4718-8eb7-21a4c2c3fdc2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:33.776030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea22ac-4d6d-4511-80b9-647711eccda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:33.777085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea22ac-4d6d-4511-80b9-647711eccda6 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:33.777459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea22ac-4d6d-4511-80b9-647711eccda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:33.777907 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea22ac-4d6d-4511-80b9-647711eccda6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:33.779359 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea22ac-4d6d-4511-80b9-647711eccda6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:33.781157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea22ac-4d6d-4511-80b9-647711eccda6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:33.813142 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 469/943] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:20:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:20:33.851378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:33.875059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7e1c-1fdb-4718-8eb7-21a4c2c3fdc2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:33.926998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc3e50-04ce-4a78-a59b-62b2bfdb6f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:33.927962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc3e50-04ce-4a78-a59b-62b2bfdb6f27 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:33.928392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc3e50-04ce-4a78-a59b-62b2bfdb6f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:33.928811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc3e50-04ce-4a78-a59b-62b2bfdb6f27 None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/ecdfe8d98368455db8b67097051b9e1c/roles/7b5b4b92aecb413e92b114c40fdff615` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:33.932004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc3e50-04ce-4a78-a59b-62b2bfdb6f27 None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=ecdfe8d98368455db8b67097051b9e1c, role_id=7b5b4b92aecb413e92b114c40fdff615)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:33.933795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc3e50-04ce-4a78-a59b-62b2bfdb6f27 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:33.949946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 475/944] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:20:33 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/ecdfe8d98368455db8b67097051b9e1c/roles/7b5b4b92aecb413e92b114c40fdff615 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:20:34.271491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500d13-2968-47f7-9a8e-59c7e95adddd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:34.271681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500d13-2968-47f7-9a8e-59c7e95adddd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:34.271958 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500d13-2968-47f7-9a8e-59c7e95adddd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:34.273733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 470/945] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:34.281539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdec46-dbda-407f-8aa9-fbf77d681a2e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:34.281940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdec46-dbda-407f-8aa9-fbf77d681a2e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:34.282312 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdec46-dbda-407f-8aa9-fbf77d681a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:34.300937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-befdec46-dbda-407f-8aa9-fbf77d681a2e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:34.302170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-befdec46-dbda-407f-8aa9-fbf77d681a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:34.373128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 476/946] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:34.640831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3500d13-2968-47f7-9a8e-59c7e95adddd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:34.738440 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:34.749934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3500d13-2968-47f7-9a8e-59c7e95adddd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:34.792832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebceb77-6dd4-462e-a4bc-b6ebdfe1596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:34.793501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebceb77-6dd4-462e-a4bc-b6ebdfe1596d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:34.793782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebceb77-6dd4-462e-a4bc-b6ebdfe1596d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:34.794053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebceb77-6dd4-462e-a4bc-b6ebdfe1596d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:34.794693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebceb77-6dd4-462e-a4bc-b6ebdfe1596d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:34.796176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebceb77-6dd4-462e-a4bc-b6ebdfe1596d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-aebceb77-6dd4-462e-a4bc-b6ebdfe1596d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:34.806298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:34.807261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:34.809187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 471/947] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:34.813626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdec46-dbda-407f-8aa9-fbf77d681a2e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:34.881330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:34.922400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdec46-dbda-407f-8aa9-fbf77d681a2e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:34.961475 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a3ff0-e837-4b0b-8642-4ff0f4f9e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:34.962089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a3ff0-e837-4b0b-8642-4ff0f4f9e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:34.962368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a3ff0-e837-4b0b-8642-4ff0f4f9e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:34.962643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a3ff0-e837-4b0b-8642-4ff0f4f9e2f8 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:34.963279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a3ff0-e837-4b0b-8642-4ff0f4f9e2f8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:34.963583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a3ff0-e837-4b0b-8642-4ff0f4f9e2f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:34.964936 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a3ff0-e837-4b0b-8642-4ff0f4f9e2f8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:34.970285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 477/948] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 10:20:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:34.975918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebceb77-6dd4-462e-a4bc-b6ebdfe1596d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:35.083147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebceb77-6dd4-462e-a4bc-b6ebdfe1596d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:35.122549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64eac5-04e0-449c-afee-862d9b9d8f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:35.123579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64eac5-04e0-449c-afee-862d9b9d8f21 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:35.124075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64eac5-04e0-449c-afee-862d9b9d8f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:35.124543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64eac5-04e0-449c-afee-862d9b9d8f21 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:35.125467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64eac5-04e0-449c-afee-862d9b9d8f21 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:35.125979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64eac5-04e0-449c-afee-862d9b9d8f21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:35.127624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64eac5-04e0-449c-afee-862d9b9d8f21 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:35.134890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 472/949] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 10:20:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:35.142460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a3ff0-e837-4b0b-8642-4ff0f4f9e2f8 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:35.240010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a965f-34ce-4161-afa3-9ab769124633 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:35.240191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a965f-34ce-4161-afa3-9ab769124633 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:35.240478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a965f-34ce-4161-afa3-9ab769124633 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:35.242120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 473/950] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:35.243098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a3ff0-e837-4b0b-8642-4ff0f4f9e2f8 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:35.247437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a298ab-5e99-484a-b18d-4a43f8b68ea8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:35.247720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a298ab-5e99-484a-b18d-4a43f8b68ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:35.247993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a298ab-5e99-484a-b18d-4a43f8b68ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:35.266374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d1a298ab-5e99-484a-b18d-4a43f8b68ea8 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:35.267568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d1a298ab-5e99-484a-b18d-4a43f8b68ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:35.280911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:35.280911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d22ed9-2479-4005-ad12-2bd5da6099f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:35.280911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d22ed9-2479-4005-ad12-2bd5da6099f9 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:35.280911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d22ed9-2479-4005-ad12-2bd5da6099f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:35.281392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d22ed9-2479-4005-ad12-2bd5da6099f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:35.281597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d22ed9-2479-4005-ad12-2bd5da6099f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:35.283175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d22ed9-2479-4005-ad12-2bd5da6099f9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:35.291103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:35.316046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 478/951] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:20:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:35.368749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 474/952] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:35.645805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d22ed9-2479-4005-ad12-2bd5da6099f9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:35.753747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d22ed9-2479-4005-ad12-2bd5da6099f9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:35.790012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:35.791013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:35.791493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:35.791991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:35.792823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:35.794461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:35.797272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WARNING keystone.server.flask.common [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 26 10:20:35.817334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.sql.core [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 10:20:35.817334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 10:20:35.817334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [parameters: {'id': '5dbc46f3a6a34ea2ab57ca11de58942f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 10:20:35.817334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81436) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5dbc46f3a6a34ea2ab57ca11de58942f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5dbc46f3a6a34ea2ab57ca11de58942f. Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application conn.query(q) Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 10:20:35.834959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result.read() Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 26 10:20:35.835857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application next(self.gen) Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application yield resource Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application next(self.gen) Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise self.value Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application session.commit() Sep 26 10:20:35.837371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.session.flush() Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application compat.raise_( Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 10:20:35.838273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 10:20:35.839142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application conn.query(q) Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application result.read() Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 10:20:35.839909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [parameters: {'id': '5dbc46f3a6a34ea2ab57ca11de58942f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:35.840750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:35.843513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:35.845687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:35.845687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 26 10:20:35.845687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 26 10:20:35.845687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:35.845687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:35.845687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 26 10:20:35.845687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 26 10:20:35.845687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5dbc46f3a6a34ea2ab57ca11de58942f. Sep 26 10:20:35.845687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:35.848791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 479/953] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Sep 26 10:20:35 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:35.858114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a298ab-5e99-484a-b18d-4a43f8b68ea8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:35.963720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a298ab-5e99-484a-b18d-4a43f8b68ea8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:36.007355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578f9f0-beb6-48a1-a3e9-ad0d888f7d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:36.008975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578f9f0-beb6-48a1-a3e9-ad0d888f7d56 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:36.009457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578f9f0-beb6-48a1-a3e9-ad0d888f7d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:36.009920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578f9f0-beb6-48a1-a3e9-ad0d888f7d56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:36.018135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578f9f0-beb6-48a1-a3e9-ad0d888f7d56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:36.019955 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578f9f0-beb6-48a1-a3e9-ad0d888f7d56 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2578f9f0-beb6-48a1-a3e9-ad0d888f7d56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:36.032432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:36.033464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:36.034587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:36.034587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:36.034587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:36.034587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:36.034587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:36.034587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:36.034587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:36.034587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:36.036553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 475/954] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:36.043148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:36.094802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:36.115564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af114-b8cd-457d-8f5d-d7347e5d3406 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:36.115846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af114-b8cd-457d-8f5d-d7347e5d3406 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:36.116118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af114-b8cd-457d-8f5d-d7347e5d3406 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:36.117987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 476/955] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:36.123127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cbb16-b0bc-457e-8359-f1448185c89d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:36.123510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cbb16-b0bc-457e-8359-f1448185c89d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:36.123880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cbb16-b0bc-457e-8359-f1448185c89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:36.137519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:36.143459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9b7cbb16-b0bc-457e-8359-f1448185c89d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:36.144937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9b7cbb16-b0bc-457e-8359-f1448185c89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:36.159301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a079-14fc-4870-bd44-f30331bde082 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:36.203811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a47d13-c074-41a0-83d5-50dcd746bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:36.204435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47d13-c074-41a0-83d5-50dcd746bb54 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:36.204712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47d13-c074-41a0-83d5-50dcd746bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:36.205004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47d13-c074-41a0-83d5-50dcd746bb54 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:36.205683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a47d13-c074-41a0-83d5-50dcd746bb54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:36.205985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a47d13-c074-41a0-83d5-50dcd746bb54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:36.207886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a47d13-c074-41a0-83d5-50dcd746bb54 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:36.229174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 477/956] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:36.232280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 480/957] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:36.310972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce7bc0-16ea-462c-bbd1-c98dd61167d8 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:36.311370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce7bc0-16ea-462c-bbd1-c98dd61167d8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:36.311714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce7bc0-16ea-462c-bbd1-c98dd61167d8 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:36.313456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 478/958] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:36.319225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5855ec-2da6-443e-991d-d4687fc39edc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:36.319514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5855ec-2da6-443e-991d-d4687fc39edc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:36.319769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5855ec-2da6-443e-991d-d4687fc39edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:36.340005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9f5855ec-2da6-443e-991d-d4687fc39edc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:36.341570 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9f5855ec-2da6-443e-991d-d4687fc39edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:36.416345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 481/959] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:36.497042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce7bc0-16ea-462c-bbd1-c98dd61167d8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:36.602420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce7bc0-16ea-462c-bbd1-c98dd61167d8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:36.638466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb237-7dc6-4410-a3bc-03fb05ae313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:36.639445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb237-7dc6-4410-a3bc-03fb05ae313f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:36.639922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb237-7dc6-4410-a3bc-03fb05ae313f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:36.640387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb237-7dc6-4410-a3bc-03fb05ae313f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:36.641189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb237-7dc6-4410-a3bc-03fb05ae313f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:36.642773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb237-7dc6-4410-a3bc-03fb05ae313f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:36.646132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-41edb237-7dc6-4410-a3bc-03fb05ae313f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:36.654441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:36.655581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 10:20:36.656447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:36.662618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 479/960] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:36.670266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5855ec-2da6-443e-991d-d4687fc39edc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:36.701838 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:36.731464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb237-7dc6-4410-a3bc-03fb05ae313f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:36.781761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5855ec-2da6-443e-991d-d4687fc39edc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:36.821232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7060-53f0-44d7-a148-b5ca9020f470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:36.822638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7060-53f0-44d7-a148-b5ca9020f470 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:36.823096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7060-53f0-44d7-a148-b5ca9020f470 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:36.823582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7060-53f0-44d7-a148-b5ca9020f470 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:36.824375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e7060-53f0-44d7-a148-b5ca9020f470 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:36.824863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e7060-53f0-44d7-a148-b5ca9020f470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:36.826567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e7060-53f0-44d7-a148-b5ca9020f470 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:36.837031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 482/961] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:36.838388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7060-53f0-44d7-a148-b5ca9020f470 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:36.840299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb237-7dc6-4410-a3bc-03fb05ae313f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:36.875656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ce3f-7b9b-4015-94dc-e8d8e5da2688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:36.876306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ce3f-7b9b-4015-94dc-e8d8e5da2688 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:36.876558 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ce3f-7b9b-4015-94dc-e8d8e5da2688 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:36.876813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ce3f-7b9b-4015-94dc-e8d8e5da2688 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:36.887826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2ce3f-7b9b-4015-94dc-e8d8e5da2688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-dfb2ce3f-7b9b-4015-94dc-e8d8e5da2688 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:36.893086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:36.893974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:36.894820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:36.899122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 480/962] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 10:20:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:36.899949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ce3f-7b9b-4015-94dc-e8d8e5da2688 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:36.941990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:36.950470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7060-53f0-44d7-a148-b5ca9020f470 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:36.963630 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:36.987997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aa2ee-0b24-40da-9a9a-0d26827d9c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:36.989127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aa2ee-0b24-40da-9a9a-0d26827d9c08 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:36.989600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aa2ee-0b24-40da-9a9a-0d26827d9c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:36.990158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aa2ee-0b24-40da-9a9a-0d26827d9c08 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:36.991114 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aa2ee-0b24-40da-9a9a-0d26827d9c08 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:36.991709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aa2ee-0b24-40da-9a9a-0d26827d9c08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:36.993656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aa2ee-0b24-40da-9a9a-0d26827d9c08 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:36.999650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 483/963] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:37.017071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ce3f-7b9b-4015-94dc-e8d8e5da2688 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:37.055740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003e908-6eae-45cf-bf5a-60bcd30c710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:37.056693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003e908-6eae-45cf-bf5a-60bcd30c710e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:37.057232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003e908-6eae-45cf-bf5a-60bcd30c710e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:37.057703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003e908-6eae-45cf-bf5a-60bcd30c710e None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:37.058584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003e908-6eae-45cf-bf5a-60bcd30c710e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:37.059119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003e908-6eae-45cf-bf5a-60bcd30c710e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:37.060731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003e908-6eae-45cf-bf5a-60bcd30c710e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:37.071758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 481/964] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 10:20:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:37.080829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aa2ee-0b24-40da-9a9a-0d26827d9c08 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:37.192235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aa2ee-0b24-40da-9a9a-0d26827d9c08 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:37.234002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94372eb9-f0b2-4a21-b85e-51d079aefd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:37.235041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372eb9-f0b2-4a21-b85e-51d079aefd7d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:37.235592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372eb9-f0b2-4a21-b85e-51d079aefd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:37.236072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372eb9-f0b2-4a21-b85e-51d079aefd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:37.247627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94372eb9-f0b2-4a21-b85e-51d079aefd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:37.249089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94372eb9-f0b2-4a21-b85e-51d079aefd7d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-94372eb9-f0b2-4a21-b85e-51d079aefd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:37.263411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:37.264394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:37.265359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:37.265359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:37.265359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:37.265359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 484/965] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:37.271688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003e908-6eae-45cf-bf5a-60bcd30c710e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:37.376985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003e908-6eae-45cf-bf5a-60bcd30c710e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:37.401349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:37.412116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560f088-fe2a-4ea2-ad89-144f98a42d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:37.412734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f088-fe2a-4ea2-ad89-144f98a42d89 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:37.413042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f088-fe2a-4ea2-ad89-144f98a42d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:37.413309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f088-fe2a-4ea2-ad89-144f98a42d89 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:37.414089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f088-fe2a-4ea2-ad89-144f98a42d89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:37.414386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f088-fe2a-4ea2-ad89-144f98a42d89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:37.415797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f088-fe2a-4ea2-ad89-144f98a42d89 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:37.429008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 482/966] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:37.435659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94372eb9-f0b2-4a21-b85e-51d079aefd7d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:37.453452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:37.547377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94372eb9-f0b2-4a21-b85e-51d079aefd7d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:37.558371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109429-27e7-4c3f-a172-30c0ecd1ecbd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:37.558710 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109429-27e7-4c3f-a172-30c0ecd1ecbd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:37.558921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109429-27e7-4c3f-a172-30c0ecd1ecbd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:37.560502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 483/967] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:20:37.565687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ccc5c-a033-441b-adbc-941b5049796c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:37.565969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ccc5c-a033-441b-adbc-941b5049796c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:37.566245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ccc5c-a033-441b-adbc-941b5049796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:37.584032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ae1ccc5c-a033-441b-adbc-941b5049796c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:37.585535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ae1ccc5c-a033-441b-adbc-941b5049796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:37.587946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01afb9-3dec-4d78-8e54-20ec284eeb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:37.588965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01afb9-3dec-4d78-8e54-20ec284eeb3b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:37.589266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01afb9-3dec-4d78-8e54-20ec284eeb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:37.589539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01afb9-3dec-4d78-8e54-20ec284eeb3b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:37.602427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01afb9-3dec-4d78-8e54-20ec284eeb3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:37.604369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01afb9-3dec-4d78-8e54-20ec284eeb3b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-8a01afb9-3dec-4d78-8e54-20ec284eeb3b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:37.620866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:37.622011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:37.622960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:37.622960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:37.622960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:37.622960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:37.622960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:37.622960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:37.622960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:37.622960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:37.622960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 10:20:37.622960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:37.625570 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 485/968] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 10:20:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:37.631499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01afb9-3dec-4d78-8e54-20ec284eeb3b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:37.665277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 484/969] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:20:37.709292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:37.738713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01afb9-3dec-4d78-8e54-20ec284eeb3b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:37.773278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e0507-1fbe-44ff-aa69-179c29d5cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:37.774264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e0507-1fbe-44ff-aa69-179c29d5cd5c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:37.774743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e0507-1fbe-44ff-aa69-179c29d5cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:37.775211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e0507-1fbe-44ff-aa69-179c29d5cd5c None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:37.776131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e0507-1fbe-44ff-aa69-179c29d5cd5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:37.776651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e0507-1fbe-44ff-aa69-179c29d5cd5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:37.778475 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e0507-1fbe-44ff-aa69-179c29d5cd5c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:37.796577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 486/970] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 10:20:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:37.802345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ccc5c-a033-441b-adbc-941b5049796c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:37.905815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ccc5c-a033-441b-adbc-941b5049796c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:37.920000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:37.935140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e0507-1fbe-44ff-aa69-179c29d5cd5c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:37.946235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdb77-009c-41b0-95d4-fcb902078056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:37.947036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdb77-009c-41b0-95d4-fcb902078056 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:37.947787 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdb77-009c-41b0-95d4-fcb902078056 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:37.948244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdb77-009c-41b0-95d4-fcb902078056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.035485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bdb77-009c-41b0-95d4-fcb902078056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:38.037148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bdb77-009c-41b0-95d4-fcb902078056 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:38.064768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e0507-1fbe-44ff-aa69-179c29d5cd5c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:38.101727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:38.115084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7b15a-c42a-47ce-aa0b-acb60ac8f273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:38.116610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7b15a-c42a-47ce-aa0b-acb60ac8f273 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.117145 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7b15a-c42a-47ce-aa0b-acb60ac8f273 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.118150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7b15a-c42a-47ce-aa0b-acb60ac8f273 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.119384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7b15a-c42a-47ce-aa0b-acb60ac8f273 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:38.121650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7b15a-c42a-47ce-aa0b-acb60ac8f273 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f8a7b15a-c42a-47ce-aa0b-acb60ac8f273 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:38.134759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:38.135781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:38.136628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:38.138752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 487/971] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:38.144417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7b15a-c42a-47ce-aa0b-acb60ac8f273 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:38.156246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 485/972] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:20:38.157943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdb77-009c-41b0-95d4-fcb902078056 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:38.176864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:38.256055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7b15a-c42a-47ce-aa0b-acb60ac8f273 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:38.289916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdb77-009c-41b0-95d4-fcb902078056 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:38.295295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41f7f3-e67b-49cf-bc03-f4f0e216c1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:38.296034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f7f3-e67b-49cf-bc03-f4f0e216c1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.296323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f7f3-e67b-49cf-bc03-f4f0e216c1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.296647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f7f3-e67b-49cf-bc03-f4f0e216c1b3 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.297339 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41f7f3-e67b-49cf-bc03-f4f0e216c1b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:38.297645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41f7f3-e67b-49cf-bc03-f4f0e216c1b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:38.299069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41f7f3-e67b-49cf-bc03-f4f0e216c1b3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:38.306440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 488/973] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 10:20:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:38.316442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41f7f3-e67b-49cf-bc03-f4f0e216c1b3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:38.331935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661808fe-7d62-4c6c-b01f-9530f1193403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:38.333022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661808fe-7d62-4c6c-b01f-9530f1193403 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.333504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661808fe-7d62-4c6c-b01f-9530f1193403 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.334054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661808fe-7d62-4c6c-b01f-9530f1193403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.346064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661808fe-7d62-4c6c-b01f-9530f1193403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:38.347934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661808fe-7d62-4c6c-b01f-9530f1193403 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-661808fe-7d62-4c6c-b01f-9530f1193403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:38.363964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:38.364916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:38.365820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:38.365820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:38.365820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:38.368103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 486/974] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:38.374334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661808fe-7d62-4c6c-b01f-9530f1193403 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:38.387024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:38.444136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41f7f3-e67b-49cf-bc03-f4f0e216c1b3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:38.450467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:38.486658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d680df8-af1f-4eaa-85da-100a1cef2455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:38.487120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680df8-af1f-4eaa-85da-100a1cef2455 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.487403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680df8-af1f-4eaa-85da-100a1cef2455 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.487680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680df8-af1f-4eaa-85da-100a1cef2455 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.488384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d680df8-af1f-4eaa-85da-100a1cef2455 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:38.488670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d680df8-af1f-4eaa-85da-100a1cef2455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:38.490368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d680df8-af1f-4eaa-85da-100a1cef2455 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:38.494346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661808fe-7d62-4c6c-b01f-9530f1193403 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:38.501471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 489/975] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 10:20:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:38.502609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d680df8-af1f-4eaa-85da-100a1cef2455 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:38.531652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bed90-bd61-4467-bbb1-531bc8de6918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:38.532258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bed90-bd61-4467-bbb1-531bc8de6918 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.532533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bed90-bd61-4467-bbb1-531bc8de6918 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.532800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bed90-bd61-4467-bbb1-531bc8de6918 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.533460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bed90-bd61-4467-bbb1-531bc8de6918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:38.533760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bed90-bd61-4467-bbb1-531bc8de6918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:38.535168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bed90-bd61-4467-bbb1-531bc8de6918 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:38.547068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 487/976] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:38.552758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4e800-c011-450e-956a-14e5a93d07ab None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.552758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4e800-c011-450e-956a-14e5a93d07ab None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.552758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4e800-c011-450e-956a-14e5a93d07ab None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.552758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 488/977] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:38.553130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4e800-c011-450e-956a-14e5a93d07ab None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:38.619959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d680df8-af1f-4eaa-85da-100a1cef2455 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:38.642649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:38.656361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e80515-9b66-4c87-81bb-8c185a0859e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:38.657077 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e80515-9b66-4c87-81bb-8c185a0859e2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.657296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e80515-9b66-4c87-81bb-8c185a0859e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.657531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e80515-9b66-4c87-81bb-8c185a0859e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.658227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e80515-9b66-4c87-81bb-8c185a0859e2 None admin] RBAC: Adding query filter params (interface=admin, service_id=e927b786befa4c429934766af1a9ac28, region_id=RegionOne) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:38.658530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e80515-9b66-4c87-81bb-8c185a0859e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:38.659865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e80515-9b66-4c87-81bb-8c185a0859e2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:38.664888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4e800-c011-450e-956a-14e5a93d07ab None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:38.670226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 490/978] 10.222.0.18 () {56 vars in 1249 bytes} [Mon Sep 26 10:20:38 2022] GET /identity/v3/endpoints?service_id=e927b786befa4c429934766af1a9ac28&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:38.670226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568088bd-b262-41ee-ad6a-7c9b55e16aaf None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.670226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568088bd-b262-41ee-ad6a-7c9b55e16aaf None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.670226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568088bd-b262-41ee-ad6a-7c9b55e16aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.685395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-568088bd-b262-41ee-ad6a-7c9b55e16aaf None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:38.686559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-568088bd-b262-41ee-ad6a-7c9b55e16aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:38.694393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:38.706532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183ac60-2718-41e8-96ba-3adba79bbe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:38.707166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183ac60-2718-41e8-96ba-3adba79bbe0c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.707441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183ac60-2718-41e8-96ba-3adba79bbe0c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.707717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183ac60-2718-41e8-96ba-3adba79bbe0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.715001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183ac60-2718-41e8-96ba-3adba79bbe0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:38.716437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183ac60-2718-41e8-96ba-3adba79bbe0c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2183ac60-2718-41e8-96ba-3adba79bbe0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:38.727535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:38.728438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:38.729367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:38.729367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:38.729367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:38.729367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:38.729367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:38.729367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:38.729367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:38.729367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:38.733740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 489/979] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:38.734934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183ac60-2718-41e8-96ba-3adba79bbe0c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:38.758980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 491/980] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:38.759643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568088bd-b262-41ee-ad6a-7c9b55e16aaf None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:38.865729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183ac60-2718-41e8-96ba-3adba79bbe0c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:38.867885 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568088bd-b262-41ee-ad6a-7c9b55e16aaf None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:38.886084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:38.906396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a75e4d-c380-424b-81ef-30f0cc04df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:38.906994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a75e4d-c380-424b-81ef-30f0cc04df56 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.907269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a75e4d-c380-424b-81ef-30f0cc04df56 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.907539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a75e4d-c380-424b-81ef-30f0cc04df56 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.908218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a75e4d-c380-424b-81ef-30f0cc04df56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:38.908519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a75e4d-c380-424b-81ef-30f0cc04df56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:38.909420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba239c-1cc4-456d-8a81-b935d9f9edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:38.909953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a75e4d-c380-424b-81ef-30f0cc04df56 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:38.910657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba239c-1cc4-456d-8a81-b935d9f9edb3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:38.911082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba239c-1cc4-456d-8a81-b935d9f9edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:38.911608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba239c-1cc4-456d-8a81-b935d9f9edb3 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:38.912497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba239c-1cc4-456d-8a81-b935d9f9edb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:38.914023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba239c-1cc4-456d-8a81-b935d9f9edb3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:38.928319 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 492/981] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:38.928549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 490/982] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 10:20:38 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:20:38.928660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a75e4d-c380-424b-81ef-30f0cc04df56 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:39.041138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a75e4d-c380-424b-81ef-30f0cc04df56 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:39.064082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba239c-1cc4-456d-8a81-b935d9f9edb3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:39.081008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cb33c-fd52-4b55-ae17-1e1676b6b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:39.081723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cb33c-fd52-4b55-ae17-1e1676b6b75d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:39.082005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cb33c-fd52-4b55-ae17-1e1676b6b75d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:39.082386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cb33c-fd52-4b55-ae17-1e1676b6b75d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:39.083125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cb33c-fd52-4b55-ae17-1e1676b6b75d None admin] RBAC: Adding query filter params (role.id=7b5b4b92aecb413e92b114c40fdff615, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=ecdfe8d98368455db8b67097051b9e1c) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:39.083436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cb33c-fd52-4b55-ae17-1e1676b6b75d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:39.085058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cb33c-fd52-4b55-ae17-1e1676b6b75d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:39.092391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 493/983] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:38 2022] GET /identity/v3/role_assignments?user.id=ecdfe8d98368455db8b67097051b9e1c&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=7b5b4b92aecb413e92b114c40fdff615 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:39.126912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:39.192658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba239c-1cc4-456d-8a81-b935d9f9edb3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:39.230532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d3595-5081-417e-acd2-6625c9e49629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:39.231152 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d3595-5081-417e-acd2-6625c9e49629 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:39.231431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d3595-5081-417e-acd2-6625c9e49629 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:39.231704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d3595-5081-417e-acd2-6625c9e49629 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:39.232370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d3595-5081-417e-acd2-6625c9e49629 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:39.233876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d3595-5081-417e-acd2-6625c9e49629 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:39.236539 dv-cinder-844563-7-smb devstack@keystone.service[81437]: WARNING keystone.server.flask.common [None req-310d3595-5081-417e-acd2-6625c9e49629 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 26 10:20:39.251167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.sql.core [None req-310d3595-5081-417e-acd2-6625c9e49629 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 10:20:39.251167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 10:20:39.251167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [parameters: {'user_id': 'dd1a91143a7d4493a0af87beab03ab57', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 10:20:39.251167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81437) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-310d3595-5081-417e-acd2-6625c9e49629 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Sep 26 10:20:39.259873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 10:20:39.260824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application yield resource Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application next(self.gen) Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise self.value Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application session.commit() Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 10:20:39.261893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.session.flush() Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application compat.raise_( Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 10:20:39.262777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 10:20:39.263660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application conn.query(q) Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application result.read() Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 10:20:39.264507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dd1a91143a7d4493a0af87beab03ab57', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:39.265368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 26 10:20:39.266129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 26 10:20:39.269420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 26 10:20:39.269420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 26 10:20:39.269420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 10:20:39.269420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 10:20:39.269420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 10:20:39.269420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:39.269420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 491/984] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Sep 26 10:20:39 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:39.273012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cb33c-fd52-4b55-ae17-1e1676b6b75d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:39.285225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19ff05-1d45-4fb9-9f4c-269e78a17f54 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:39.285807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19ff05-1d45-4fb9-9f4c-269e78a17f54 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:39.286083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19ff05-1d45-4fb9-9f4c-269e78a17f54 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:39.291271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 492/985] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:39.296747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56673c-809e-4d41-8f39-ba97d4e602db None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:39.297055 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56673c-809e-4d41-8f39-ba97d4e602db None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:39.297328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56673c-809e-4d41-8f39-ba97d4e602db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:39.319219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4a56673c-809e-4d41-8f39-ba97d4e602db None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:39.321316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4a56673c-809e-4d41-8f39-ba97d4e602db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:39.333342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:39.415979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cb33c-fd52-4b55-ae17-1e1676b6b75d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:39.417788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 493/986] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:39.455410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27bed1-fe93-448d-abf3-f6a7c3aaca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:39.456100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27bed1-fe93-448d-abf3-f6a7c3aaca7f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:39.456385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27bed1-fe93-448d-abf3-f6a7c3aaca7f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:39.456656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27bed1-fe93-448d-abf3-f6a7c3aaca7f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:39.465042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27bed1-fe93-448d-abf3-f6a7c3aaca7f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:39.466460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27bed1-fe93-448d-abf3-f6a7c3aaca7f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ab27bed1-fe93-448d-abf3-f6a7c3aaca7f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:39.477810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:39.478761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:39.479688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 494/987] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:20:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:39.484940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56673c-809e-4d41-8f39-ba97d4e602db None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:39.531055 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:39.598592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56673c-809e-4d41-8f39-ba97d4e602db None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:39.635586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58046ba4-0cd0-47a1-86d7-95898e76f130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:39.636194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58046ba4-0cd0-47a1-86d7-95898e76f130 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:39.636530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58046ba4-0cd0-47a1-86d7-95898e76f130 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:39.636810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58046ba4-0cd0-47a1-86d7-95898e76f130 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:39.637538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58046ba4-0cd0-47a1-86d7-95898e76f130 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:39.637838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58046ba4-0cd0-47a1-86d7-95898e76f130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:39.639379 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58046ba4-0cd0-47a1-86d7-95898e76f130 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:39.675036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 494/988] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 10:20:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:39.691921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27bed1-fe93-448d-abf3-f6a7c3aaca7f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:39.802714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:39.806091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27bed1-fe93-448d-abf3-f6a7c3aaca7f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:39.843056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dd547-b72b-4ec4-ae60-c23bd9163b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:39.843679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dd547-b72b-4ec4-ae60-c23bd9163b59 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:39.843958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dd547-b72b-4ec4-ae60-c23bd9163b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:39.844226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dd547-b72b-4ec4-ae60-c23bd9163b59 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:39.844890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dd547-b72b-4ec4-ae60-c23bd9163b59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:39.846308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dd547-b72b-4ec4-ae60-c23bd9163b59 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:39.868854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 495/989] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:20:39 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:41.218725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f46a7d-dc89-43b9-8a19-f0fca60388a9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:41.219275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f46a7d-dc89-43b9-8a19-f0fca60388a9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:41.219275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f46a7d-dc89-43b9-8a19-f0fca60388a9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:41.220649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 495/990] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:41.225825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c681-9367-4a1f-be4b-a65da98fb97d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:41.226256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c681-9367-4a1f-be4b-a65da98fb97d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:41.226400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c681-9367-4a1f-be4b-a65da98fb97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:41.246673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3663c681-9367-4a1f-be4b-a65da98fb97d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:41.247905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3663c681-9367-4a1f-be4b-a65da98fb97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:41.325991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 496/991] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:41.364984 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6ffcd-a379-46bd-814e-4483414b18a6 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:41.364984 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6ffcd-a379-46bd-814e-4483414b18a6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:41.364984 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6ffcd-a379-46bd-814e-4483414b18a6 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:41.365640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 496/992] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:41.371340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc1d28-a8d2-4282-acd1-0c900a4c8030 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:41.371628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc1d28-a8d2-4282-acd1-0c900a4c8030 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:41.371902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc1d28-a8d2-4282-acd1-0c900a4c8030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:41.389775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c4dc1d28-a8d2-4282-acd1-0c900a4c8030 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:41.390928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c4dc1d28-a8d2-4282-acd1-0c900a4c8030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:41.457504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 497/993] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:41.593171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6ffcd-a379-46bd-814e-4483414b18a6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:41.692831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:41.699223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6ffcd-a379-46bd-814e-4483414b18a6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:41.725740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc1d28-a8d2-4282-acd1-0c900a4c8030 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:41.737132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcffe4a-7e03-4f68-b609-9ed98da2875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:41.738352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcffe4a-7e03-4f68-b609-9ed98da2875f None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:41.739030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcffe4a-7e03-4f68-b609-9ed98da2875f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:41.739470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcffe4a-7e03-4f68-b609-9ed98da2875f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:41.740434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcffe4a-7e03-4f68-b609-9ed98da2875f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:41.742837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcffe4a-7e03-4f68-b609-9ed98da2875f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:41.743789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-adcffe4a-7e03-4f68-b609-9ed98da2875f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:41.752680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:41.754015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:41.755053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 497/994] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 10:20:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:41.759568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcffe4a-7e03-4f68-b609-9ed98da2875f None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:41.836675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc1d28-a8d2-4282-acd1-0c900a4c8030 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:41.861791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcffe4a-7e03-4f68-b609-9ed98da2875f None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:41.873068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c578be-3f0e-40d1-b63a-f897540ebee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:41.874041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c578be-3f0e-40d1-b63a-f897540ebee9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:41.874471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c578be-3f0e-40d1-b63a-f897540ebee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:41.875009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c578be-3f0e-40d1-b63a-f897540ebee9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:41.875600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c578be-3f0e-40d1-b63a-f897540ebee9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:41.876972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c578be-3f0e-40d1-b63a-f897540ebee9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-86c578be-3f0e-40d1-b63a-f897540ebee9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:41.886633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:41.887600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:41.888421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 498/995] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Sep 26 10:20:41 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:41.893365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c578be-3f0e-40d1-b63a-f897540ebee9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:41.899736 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b8d8-e198-4a15-86f6-e65948405870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:41.900346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b8d8-e198-4a15-86f6-e65948405870 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:41.900623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b8d8-e198-4a15-86f6-e65948405870 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:41.900891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b8d8-e198-4a15-86f6-e65948405870 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:41.901543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33b8d8-e198-4a15-86f6-e65948405870 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:41.902096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33b8d8-e198-4a15-86f6-e65948405870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:41.903884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33b8d8-e198-4a15-86f6-e65948405870 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:41.909556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 498/996] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 10:20:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:41.914941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b8d8-e198-4a15-86f6-e65948405870 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:41.947496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:41.989530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:42.013118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c578be-3f0e-40d1-b63a-f897540ebee9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:42.043281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b8d8-e198-4a15-86f6-e65948405870 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:42.049449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c0396-f4a2-4b60-9eea-6c110b8b2992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:42.050476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c0396-f4a2-4b60-9eea-6c110b8b2992 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:42.050769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c0396-f4a2-4b60-9eea-6c110b8b2992 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:42.051044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c0396-f4a2-4b60-9eea-6c110b8b2992 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:42.051685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c0396-f4a2-4b60-9eea-6c110b8b2992 None admin] RBAC: Adding query filter params (name=image) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:42.052430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c0396-f4a2-4b60-9eea-6c110b8b2992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:42.053824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c0396-f4a2-4b60-9eea-6c110b8b2992 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:42.058804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 499/997] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:42.059962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d3fab-e271-4884-8a2d-def389db2fe9 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:42.060239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d3fab-e271-4884-8a2d-def389db2fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:42.060513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d3fab-e271-4884-8a2d-def389db2fe9 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:42.061741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 500/998] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:42.066746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139c84e-c7a3-4cb7-b596-942d8ee69f7c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:42.067031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139c84e-c7a3-4cb7-b596-942d8ee69f7c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:42.067485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139c84e-c7a3-4cb7-b596-942d8ee69f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:42.079149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe022a7-a69a-48eb-b05a-698c244aa921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:42.079750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe022a7-a69a-48eb-b05a-698c244aa921 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:42.080027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe022a7-a69a-48eb-b05a-698c244aa921 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:42.080297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe022a7-a69a-48eb-b05a-698c244aa921 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:42.080915 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe022a7-a69a-48eb-b05a-698c244aa921 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:42.081243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe022a7-a69a-48eb-b05a-698c244aa921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:42.082580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe022a7-a69a-48eb-b05a-698c244aa921 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:42.085599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2139c84e-c7a3-4cb7-b596-942d8ee69f7c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:42.087378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2139c84e-c7a3-4cb7-b596-942d8ee69f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:42.087711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 499/999] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 10:20:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:42.088459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe022a7-a69a-48eb-b05a-698c244aa921 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:42.159644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 501/1000] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:20:42.160288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139c84e-c7a3-4cb7-b596-942d8ee69f7c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:42.181140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:42.191456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe022a7-a69a-48eb-b05a-698c244aa921 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:42.227021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e09fa-4dc2-4d1e-9cfe-0e15e24112df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:42.227637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e09fa-4dc2-4d1e-9cfe-0e15e24112df None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:42.227889 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e09fa-4dc2-4d1e-9cfe-0e15e24112df None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:42.228162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e09fa-4dc2-4d1e-9cfe-0e15e24112df None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:42.228781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e09fa-4dc2-4d1e-9cfe-0e15e24112df None admin] RBAC: Adding query filter params (type=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:42.229114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e09fa-4dc2-4d1e-9cfe-0e15e24112df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:42.230475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e09fa-4dc2-4d1e-9cfe-0e15e24112df None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:42.234788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 500/1001] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:42.261052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:42.289457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139c84e-c7a3-4cb7-b596-942d8ee69f7c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:42.328169 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c28af9-eb25-45c4-ad19-93c0425c66eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:42.328787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c28af9-eb25-45c4-ad19-93c0425c66eb None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:42.329094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c28af9-eb25-45c4-ad19-93c0425c66eb None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:42.329365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c28af9-eb25-45c4-ad19-93c0425c66eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:42.330027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c28af9-eb25-45c4-ad19-93c0425c66eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:42.331383 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c28af9-eb25-45c4-ad19-93c0425c66eb None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:42.349454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 502/1002] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:20:42 2022] POST /identity/v3/endpoints => generated 325 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:42.434540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e09fa-4dc2-4d1e-9cfe-0e15e24112df None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:42.544571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e09fa-4dc2-4d1e-9cfe-0e15e24112df None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:42.585582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84e385-7b66-41a6-b309-ea17e314b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:42.586747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84e385-7b66-41a6-b309-ea17e314b587 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:42.587030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84e385-7b66-41a6-b309-ea17e314b587 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:42.587305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84e385-7b66-41a6-b309-ea17e314b587 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:42.587879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84e385-7b66-41a6-b309-ea17e314b587 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:42.589261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84e385-7b66-41a6-b309-ea17e314b587 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3b84e385-7b66-41a6-b309-ea17e314b587 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:42.598102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:42.599077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:42.599885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 501/1003] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:42.606763 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c28af9-eb25-45c4-ad19-93c0425c66eb None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:42.708842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c28af9-eb25-45c4-ad19-93c0425c66eb None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:42.743195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bcf52-21ab-4810-82f6-aa2fa6ee2497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:42.743812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bcf52-21ab-4810-82f6-aa2fa6ee2497 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:42.744088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bcf52-21ab-4810-82f6-aa2fa6ee2497 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:42.744356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bcf52-21ab-4810-82f6-aa2fa6ee2497 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:42.745005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bcf52-21ab-4810-82f6-aa2fa6ee2497 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:42.745309 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bcf52-21ab-4810-82f6-aa2fa6ee2497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:42.746666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bcf52-21ab-4810-82f6-aa2fa6ee2497 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:42.747792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:42.756995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 503/1004] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:42.758216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84e385-7b66-41a6-b309-ea17e314b587 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:42.774901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:42.863162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84e385-7b66-41a6-b309-ea17e314b587 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:42.897059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60382ff-f5f1-4b2f-8567-6b1494782ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:42.897664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60382ff-f5f1-4b2f-8567-6b1494782ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:42.897941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60382ff-f5f1-4b2f-8567-6b1494782ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:42.898208 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60382ff-f5f1-4b2f-8567-6b1494782ab3 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:42.899379 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60382ff-f5f1-4b2f-8567-6b1494782ab3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:42.899678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60382ff-f5f1-4b2f-8567-6b1494782ab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:42.901045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60382ff-f5f1-4b2f-8567-6b1494782ab3 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:42.911001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 502/1005] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:42.912221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bcf52-21ab-4810-82f6-aa2fa6ee2497 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:43.013161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bcf52-21ab-4810-82f6-aa2fa6ee2497 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:43.046850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d950d70-d88e-4e07-91a2-61fac88eede3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:43.047455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d950d70-d88e-4e07-91a2-61fac88eede3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:43.047732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d950d70-d88e-4e07-91a2-61fac88eede3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:43.047999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d950d70-d88e-4e07-91a2-61fac88eede3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:43.048686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d950d70-d88e-4e07-91a2-61fac88eede3 None admin] RBAC: Adding query filter params (interface=public, service_id=26fa71344f1c4b53a72b0b288267a9bd, region_id=RegionOne) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:43.049029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d950d70-d88e-4e07-91a2-61fac88eede3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:43.050479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d950d70-d88e-4e07-91a2-61fac88eede3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:43.056526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 504/1006] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 10:20:42 2022] GET /identity/v3/endpoints?service_id=26fa71344f1c4b53a72b0b288267a9bd&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:43.061031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60382ff-f5f1-4b2f-8567-6b1494782ab3 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:43.143771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:43.166198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60382ff-f5f1-4b2f-8567-6b1494782ab3 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:43.199811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e53396-9062-426e-a331-0bea8c6910cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:43.200408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e53396-9062-426e-a331-0bea8c6910cf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:43.200684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e53396-9062-426e-a331-0bea8c6910cf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:43.200978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e53396-9062-426e-a331-0bea8c6910cf None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:43.201564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e53396-9062-426e-a331-0bea8c6910cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:43.202943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e53396-9062-426e-a331-0bea8c6910cf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:43.214018 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 503/1007] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 10:20:43 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:20:44.397983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3078a-cf46-40fb-9277-20e0f2d20de7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:44.398524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3078a-cf46-40fb-9277-20e0f2d20de7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:44.398609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3078a-cf46-40fb-9277-20e0f2d20de7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:44.399947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 505/1008] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:44.405432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45036aa-0a74-416a-945f-07702fc4d7f6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:44.405851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45036aa-0a74-416a-945f-07702fc4d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:44.406015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45036aa-0a74-416a-945f-07702fc4d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:44.425631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b45036aa-0a74-416a-945f-07702fc4d7f6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:44.426864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b45036aa-0a74-416a-945f-07702fc4d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:44.496924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 504/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:44.543686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1cb9d-8c38-46eb-9651-906e3db00c27 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:44.543989 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1cb9d-8c38-46eb-9651-906e3db00c27 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:44.544238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1cb9d-8c38-46eb-9651-906e3db00c27 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:44.545724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 506/1010] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:44.550799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ba1e1-c55f-465f-9953-388f4dae0813 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:44.551084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ba1e1-c55f-465f-9953-388f4dae0813 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:44.551354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ba1e1-c55f-465f-9953-388f4dae0813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:44.569063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-490ba1e1-c55f-465f-9953-388f4dae0813 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:44.570220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-490ba1e1-c55f-465f-9953-388f4dae0813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:44.635253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 505/1011] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:44.760618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1cb9d-8c38-46eb-9651-906e3db00c27 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:44.823795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:44.863984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1cb9d-8c38-46eb-9651-906e3db00c27 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:44.897838 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c774b9-0608-42fd-9001-fcaf7ce5be0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:44.898360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c774b9-0608-42fd-9001-fcaf7ce5be0b None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:44.898663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c774b9-0608-42fd-9001-fcaf7ce5be0b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:44.898935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c774b9-0608-42fd-9001-fcaf7ce5be0b None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:44.899577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c774b9-0608-42fd-9001-fcaf7ce5be0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:44.900920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c774b9-0608-42fd-9001-fcaf7ce5be0b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:44.903786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ba1e1-c55f-465f-9953-388f4dae0813 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:44.905988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:44.923338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 507/1012] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:20:44 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:45.024780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ba1e1-c55f-465f-9953-388f4dae0813 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:45.067556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50ce12-eedc-4263-8d12-c98b590c6e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:45.068203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ce12-eedc-4263-8d12-c98b590c6e31 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:45.068480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ce12-eedc-4263-8d12-c98b590c6e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:45.068747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50ce12-eedc-4263-8d12-c98b590c6e31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:45.069899 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50ce12-eedc-4263-8d12-c98b590c6e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:45.071879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50ce12-eedc-4263-8d12-c98b590c6e31 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:45.073722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 506/1013] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:45.079595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c774b9-0608-42fd-9001-fcaf7ce5be0b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:45.186955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c774b9-0608-42fd-9001-fcaf7ce5be0b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:45.210508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:45.224795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479dd3a-266d-46c0-b05a-325533e4de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:45.225450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479dd3a-266d-46c0-b05a-325533e4de13 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:45.226037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479dd3a-266d-46c0-b05a-325533e4de13 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:45.226311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479dd3a-266d-46c0-b05a-325533e4de13 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:45.226999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479dd3a-266d-46c0-b05a-325533e4de13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:45.228420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479dd3a-266d-46c0-b05a-325533e4de13 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:45.264986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 508/1014] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:20:45 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:45.374662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f3b3-6713-45a6-9fd5-64d983796eb4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:45.375006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f3b3-6713-45a6-9fd5-64d983796eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:45.375220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f3b3-6713-45a6-9fd5-64d983796eb4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:45.376605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 507/1015] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:20:45.382540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1334938-c61c-405d-8834-e2e82b4dc7b8 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:45.383438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1334938-c61c-405d-8834-e2e82b4dc7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:45.383657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1334938-c61c-405d-8834-e2e82b4dc7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:45.403038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c1334938-c61c-405d-8834-e2e82b4dc7b8 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:45.404258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c1334938-c61c-405d-8834-e2e82b4dc7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:45.476174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 509/1016] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:45 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:45.742157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116f3b3-6713-45a6-9fd5-64d983796eb4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:45.812009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:45.851874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116f3b3-6713-45a6-9fd5-64d983796eb4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:45.886090 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824695c-7db0-4797-bf92-db1c0334d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:45.886717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824695c-7db0-4797-bf92-db1c0334d428 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:45.886995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824695c-7db0-4797-bf92-db1c0334d428 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:45.887266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824695c-7db0-4797-bf92-db1c0334d428 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:45.887841 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824695c-7db0-4797-bf92-db1c0334d428 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:45.889227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824695c-7db0-4797-bf92-db1c0334d428 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3824695c-7db0-4797-bf92-db1c0334d428 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:45.897858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:45.899504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:45.902340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 508/1017] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:45.905731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1334938-c61c-405d-8834-e2e82b4dc7b8 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:46.003043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1334938-c61c-405d-8834-e2e82b4dc7b8 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:46.005321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:46.042990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e0b4f-a3bc-4115-b0e5-4490051f6c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:46.043594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e0b4f-a3bc-4115-b0e5-4490051f6c22 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:46.043876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e0b4f-a3bc-4115-b0e5-4490051f6c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:46.044147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e0b4f-a3bc-4115-b0e5-4490051f6c22 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:46.044778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e0b4f-a3bc-4115-b0e5-4490051f6c22 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:46.045108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e0b4f-a3bc-4115-b0e5-4490051f6c22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:46.046461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e0b4f-a3bc-4115-b0e5-4490051f6c22 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:46.056890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 510/1018] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:46.057853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824695c-7db0-4797-bf92-db1c0334d428 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:46.160501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824695c-7db0-4797-bf92-db1c0334d428 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:46.189623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:46.197284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913d8b3-672c-4447-a6f4-ec9a0f4c1f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:46.197912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913d8b3-672c-4447-a6f4-ec9a0f4c1f37 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:46.198193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913d8b3-672c-4447-a6f4-ec9a0f4c1f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:46.198475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913d8b3-672c-4447-a6f4-ec9a0f4c1f37 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:46.199119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913d8b3-672c-4447-a6f4-ec9a0f4c1f37 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:46.199425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913d8b3-672c-4447-a6f4-ec9a0f4c1f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:46.200845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913d8b3-672c-4447-a6f4-ec9a0f4c1f37 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:46.211893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 509/1019] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 10:20:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:46.213535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e0b4f-a3bc-4115-b0e5-4490051f6c22 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:46.310555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e0b4f-a3bc-4115-b0e5-4490051f6c22 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:46.342914 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacc934-af6f-426a-a1de-3ad8e9abb4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:46.343511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacc934-af6f-426a-a1de-3ad8e9abb4cf None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:46.343787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacc934-af6f-426a-a1de-3ad8e9abb4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:46.344056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacc934-af6f-426a-a1de-3ad8e9abb4cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:46.344717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacc934-af6f-426a-a1de-3ad8e9abb4cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:46.346084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacc934-af6f-426a-a1de-3ad8e9abb4cf None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:46.377015 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 511/1020] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:20:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:20:47.113833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7cfa3-9952-4ee9-93cd-bf97214c066a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:47.114354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7cfa3-9952-4ee9-93cd-bf97214c066a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:47.114465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7cfa3-9952-4ee9-93cd-bf97214c066a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:47.115752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 510/1021] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:47.121604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e02c6-eb8b-47d6-9832-b083de0dad43 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:47.122016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e02c6-eb8b-47d6-9832-b083de0dad43 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:47.122198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e02c6-eb8b-47d6-9832-b083de0dad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:47.140787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-bf6e02c6-eb8b-47d6-9832-b083de0dad43 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:47.141978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bf6e02c6-eb8b-47d6-9832-b083de0dad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:47.160569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:47.218040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 512/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:47.495493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c696-075d-43a7-b317-3a0fe48de738 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:47.495837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c696-075d-43a7-b317-3a0fe48de738 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:47.496052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c696-075d-43a7-b317-3a0fe48de738 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:47.497466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 511/1023] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:47.498901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e02c6-eb8b-47d6-9832-b083de0dad43 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:47.502521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb47f94-3a22-4c82-b3a0-f4b6d387aeff None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:47.502808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb47f94-3a22-4c82-b3a0-f4b6d387aeff None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:47.503081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb47f94-3a22-4c82-b3a0-f4b6d387aeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:47.522060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bfb47f94-3a22-4c82-b3a0-f4b6d387aeff None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:47.523242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bfb47f94-3a22-4c82-b3a0-f4b6d387aeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:47.592597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 512/1024] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:20:47.611043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e02c6-eb8b-47d6-9832-b083de0dad43 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:47.648343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329ef9-d24d-48e0-a8b3-2d162befb72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:47.649365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329ef9-d24d-48e0-a8b3-2d162befb72e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:47.650102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329ef9-d24d-48e0-a8b3-2d162befb72e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:47.650570 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329ef9-d24d-48e0-a8b3-2d162befb72e None admin] PATH_INFO: `/v3/services/image` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:47.651366 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329ef9-d24d-48e0-a8b3-2d162befb72e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:47.653192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329ef9-d24d-48e0-a8b3-2d162befb72e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-88329ef9-d24d-48e0-a8b3-2d162befb72e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:47.662988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:47.664133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 10:20:47.665439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:47.666561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 513/1025] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Sep 26 10:20:47 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:47.670064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb47f94-3a22-4c82-b3a0-f4b6d387aeff None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:47.772191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb47f94-3a22-4c82-b3a0-f4b6d387aeff None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:47.795213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:47.807506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775a28c-e725-497b-9b66-ae322622e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:47.808111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775a28c-e725-497b-9b66-ae322622e7db None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:47.808388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775a28c-e725-497b-9b66-ae322622e7db None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:47.808706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775a28c-e725-497b-9b66-ae322622e7db None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:47.809350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775a28c-e725-497b-9b66-ae322622e7db None admin] RBAC: Adding query filter params (name=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:47.809650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775a28c-e725-497b-9b66-ae322622e7db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:47.810992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775a28c-e725-497b-9b66-ae322622e7db None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:47.821357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 513/1026] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:47.822392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329ef9-d24d-48e0-a8b3-2d162befb72e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:47.838416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:47.859789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775a28c-e725-497b-9b66-ae322622e7db None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:47.927155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329ef9-d24d-48e0-a8b3-2d162befb72e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:47.958543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775a28c-e725-497b-9b66-ae322622e7db None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:47.961601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beed24a-1cb9-4f0c-98f1-0c5842cd7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:47.962198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beed24a-1cb9-4f0c-98f1-0c5842cd7db3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:47.962476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beed24a-1cb9-4f0c-98f1-0c5842cd7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:47.962745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beed24a-1cb9-4f0c-98f1-0c5842cd7db3 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:47.963359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beed24a-1cb9-4f0c-98f1-0c5842cd7db3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:47.963659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beed24a-1cb9-4f0c-98f1-0c5842cd7db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:47.965026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beed24a-1cb9-4f0c-98f1-0c5842cd7db3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:47.974685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 514/1027] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:47.975608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beed24a-1cb9-4f0c-98f1-0c5842cd7db3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:47.998243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d826-5885-40fc-a76c-741e953c4ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:47.998884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d826-5885-40fc-a76c-741e953c4ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:47.999156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d826-5885-40fc-a76c-741e953c4ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:47.999430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d826-5885-40fc-a76c-741e953c4ab4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:48.000546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0d826-5885-40fc-a76c-741e953c4ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:48.002003 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0d826-5885-40fc-a76c-741e953c4ab4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:48.003731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 514/1028] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:48.009640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d826-5885-40fc-a76c-741e953c4ab4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:48.058863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:48.066551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:48.087134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beed24a-1cb9-4f0c-98f1-0c5842cd7db3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:48.111449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d826-5885-40fc-a76c-741e953c4ab4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:48.123056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56e7bd-483c-4835-a011-ed1abc70419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:48.123673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e7bd-483c-4835-a011-ed1abc70419a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:48.123958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e7bd-483c-4835-a011-ed1abc70419a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:48.124221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e7bd-483c-4835-a011-ed1abc70419a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:48.124911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56e7bd-483c-4835-a011-ed1abc70419a None admin] RBAC: Adding query filter params (interface=public, service_id=d284557deaf0405cacfa0e04d91d4908, region_id=RegionOne) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:48.125271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56e7bd-483c-4835-a011-ed1abc70419a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:48.126729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56e7bd-483c-4835-a011-ed1abc70419a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:48.132041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 515/1029] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 10:20:47 2022] GET /identity/v3/endpoints?service_id=d284557deaf0405cacfa0e04d91d4908&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:48.138471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56e7bd-483c-4835-a011-ed1abc70419a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:48.149212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279eee76-cba5-45e7-ad34-3d81a954436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:48.149702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eee76-cba5-45e7-ad34-3d81a954436b None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:48.149892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eee76-cba5-45e7-ad34-3d81a954436b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:48.150166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eee76-cba5-45e7-ad34-3d81a954436b None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:48.151084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279eee76-cba5-45e7-ad34-3d81a954436b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:48.152473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279eee76-cba5-45e7-ad34-3d81a954436b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:48.175242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 515/1030] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:20:48 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:20:48.251886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56e7bd-483c-4835-a011-ed1abc70419a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:48.288080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1f539-0211-4647-9811-2c2e2db15dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:48.288704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1f539-0211-4647-9811-2c2e2db15dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:48.289554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1f539-0211-4647-9811-2c2e2db15dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:48.289843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1f539-0211-4647-9811-2c2e2db15dd9 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:48.290460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1f539-0211-4647-9811-2c2e2db15dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:48.291848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1f539-0211-4647-9811-2c2e2db15dd9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:48.299255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 516/1031] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 10:20:48 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:20:48.611208 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c5e1c-5c03-445b-8300-cf5fe61526b6 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:48.611590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c5e1c-5c03-445b-8300-cf5fe61526b6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:48.611767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c5e1c-5c03-445b-8300-cf5fe61526b6 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:48.613174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 516/1032] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:48.618893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532bda7-ad68-4127-847c-80ad7a23bbe0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:48.619183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532bda7-ad68-4127-847c-80ad7a23bbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:48.619459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532bda7-ad68-4127-847c-80ad7a23bbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:48.632170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:48.638604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f532bda7-ad68-4127-847c-80ad7a23bbe0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:48.640161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f532bda7-ad68-4127-847c-80ad7a23bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:48.708758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 517/1033] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:48.974154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c5e1c-5c03-445b-8300-cf5fe61526b6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:49.081987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c5e1c-5c03-445b-8300-cf5fe61526b6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:49.097041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:49.121100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14277c1-4de0-4b5f-a1ab-ec77671cc108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:49.122087 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14277c1-4de0-4b5f-a1ab-ec77671cc108 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:49.122617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14277c1-4de0-4b5f-a1ab-ec77671cc108 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:49.123088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14277c1-4de0-4b5f-a1ab-ec77671cc108 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:49.134619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14277c1-4de0-4b5f-a1ab-ec77671cc108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-f14277c1-4de0-4b5f-a1ab-ec77671cc108 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:49.139856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:49.140766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:49.141675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:49.143415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 517/1034] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 10:20:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:49.148334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532bda7-ad68-4127-847c-80ad7a23bbe0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:49.256476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532bda7-ad68-4127-847c-80ad7a23bbe0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:49.289049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b071e-4507-4e60-b63e-8cad48e0e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:49.289645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b071e-4507-4e60-b63e-8cad48e0e807 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:49.289922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b071e-4507-4e60-b63e-8cad48e0e807 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:49.290190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b071e-4507-4e60-b63e-8cad48e0e807 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:49.290843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b071e-4507-4e60-b63e-8cad48e0e807 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:49.291143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b071e-4507-4e60-b63e-8cad48e0e807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:49.292468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b071e-4507-4e60-b63e-8cad48e0e807 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:49.294705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:49.301729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 518/1035] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 10:20:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:49.307917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14277c1-4de0-4b5f-a1ab-ec77671cc108 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:49.418692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14277c1-4de0-4b5f-a1ab-ec77671cc108 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:49.453079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ab42a-b1a5-4bba-ad90-d08d05a45639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:49.453703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab42a-b1a5-4bba-ad90-d08d05a45639 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:49.453983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab42a-b1a5-4bba-ad90-d08d05a45639 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:49.454255 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab42a-b1a5-4bba-ad90-d08d05a45639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:49.465054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ab42a-b1a5-4bba-ad90-d08d05a45639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:49.466548 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ab42a-b1a5-4bba-ad90-d08d05a45639 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-960ab42a-b1a5-4bba-ad90-d08d05a45639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:49.480857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:49.481871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:49.487416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:49.487416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:49.487416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:49.487416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 518/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:49.489124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b071e-4507-4e60-b63e-8cad48e0e807 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:49.589061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b071e-4507-4e60-b63e-8cad48e0e807 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:49.622479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c1ea3-81bc-4161-aea0-06e50e493784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:49.623082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1ea3-81bc-4161-aea0-06e50e493784 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:49.623362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1ea3-81bc-4161-aea0-06e50e493784 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:49.623634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1ea3-81bc-4161-aea0-06e50e493784 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:49.624269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c1ea3-81bc-4161-aea0-06e50e493784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:49.624571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c1ea3-81bc-4161-aea0-06e50e493784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:49.625964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c1ea3-81bc-4161-aea0-06e50e493784 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:49.638192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 519/1037] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:49.643712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ab42a-b1a5-4bba-ad90-d08d05a45639 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:49.670057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:49.744638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ab42a-b1a5-4bba-ad90-d08d05a45639 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:49.778123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f980d5a-a380-4630-aa53-a67e35036486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:49.778744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980d5a-a380-4630-aa53-a67e35036486 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:49.779026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980d5a-a380-4630-aa53-a67e35036486 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:49.779295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980d5a-a380-4630-aa53-a67e35036486 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:49.786454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f980d5a-a380-4630-aa53-a67e35036486 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:49.787880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f980d5a-a380-4630-aa53-a67e35036486 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2f980d5a-a380-4630-aa53-a67e35036486 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:49.800988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:49.801921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:49.802843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:49.802843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:49.802843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:49.802843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:49.802843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:49.802843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:49.802843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:49.802843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:49.802843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:49.802843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:49.803995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 519/1038] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 10:20:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:49.807707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c1ea3-81bc-4161-aea0-06e50e493784 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:49.866563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:49.909387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c1ea3-81bc-4161-aea0-06e50e493784 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:49.942376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aba155-285c-4f42-a66e-4db1e4451b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:49.942977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aba155-285c-4f42-a66e-4db1e4451b6a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:49.943258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aba155-285c-4f42-a66e-4db1e4451b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:49.943580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aba155-285c-4f42-a66e-4db1e4451b6a None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:49.944305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aba155-285c-4f42-a66e-4db1e4451b6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:49.944610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aba155-285c-4f42-a66e-4db1e4451b6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:49.946079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aba155-285c-4f42-a66e-4db1e4451b6a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:49.968611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 520/1039] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 10:20:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:49.969764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f980d5a-a380-4630-aa53-a67e35036486 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:50.055057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:50.071952 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f980d5a-a380-4630-aa53-a67e35036486 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:50.113468 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504df6d-8cd5-471c-8b18-7ce288ea3876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:50.114076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504df6d-8cd5-471c-8b18-7ce288ea3876 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:50.114351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504df6d-8cd5-471c-8b18-7ce288ea3876 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:50.114616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504df6d-8cd5-471c-8b18-7ce288ea3876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:50.181339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504df6d-8cd5-471c-8b18-7ce288ea3876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:50.182688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504df6d-8cd5-471c-8b18-7ce288ea3876 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:50.263902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:50.286933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 520/1040] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:20:50.288248 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aba155-285c-4f42-a66e-4db1e4451b6a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:50.405722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aba155-285c-4f42-a66e-4db1e4451b6a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:50.426682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:50.446384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fe9d0-d040-44f9-a6ac-a7a97533bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:50.446938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fe9d0-d040-44f9-a6ac-a7a97533bc11 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:50.447227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fe9d0-d040-44f9-a6ac-a7a97533bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:50.447487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fe9d0-d040-44f9-a6ac-a7a97533bc11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:50.457533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fe9d0-d040-44f9-a6ac-a7a97533bc11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:50.458956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fe9d0-d040-44f9-a6ac-a7a97533bc11 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:50.471309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf304f-b384-4b87-a594-ba6d1f3d4f05 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:50.471786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf304f-b384-4b87-a594-ba6d1f3d4f05 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:50.471863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf304f-b384-4b87-a594-ba6d1f3d4f05 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:50.473335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 521/1041] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d77fe9d0-d040-44f9-a6ac-a7a97533bc11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:50.474072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:50.474979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:50.475886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:50.475886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:50.475886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:50.477253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 521/1042] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:50.478961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3d6b-d298-4d51-8917-75cf1bceeaa9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:50.479332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3d6b-d298-4d51-8917-75cf1bceeaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:50.479669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3d6b-d298-4d51-8917-75cf1bceeaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:50.480662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fe9d0-d040-44f9-a6ac-a7a97533bc11 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:50.500586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a41c3d6b-d298-4d51-8917-75cf1bceeaa9 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:50.501816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a41c3d6b-d298-4d51-8917-75cf1bceeaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:50.567692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 522/1043] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:50.569084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3eaa7a-6c5e-4f2a-8168-1e86e9c4c730 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:50.569375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3eaa7a-6c5e-4f2a-8168-1e86e9c4c730 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:50.569643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3eaa7a-6c5e-4f2a-8168-1e86e9c4c730 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:50.571404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 523/1044] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:50.576921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4557d5-83e7-4122-a78f-84bebf25cbd6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:50.577231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4557d5-83e7-4122-a78f-84bebf25cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:50.577505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4557d5-83e7-4122-a78f-84bebf25cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:50.582131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fe9d0-d040-44f9-a6ac-a7a97533bc11 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:50.598579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cc4557d5-83e7-4122-a78f-84bebf25cbd6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:50.599795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cc4557d5-83e7-4122-a78f-84bebf25cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:50.620169 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb6150-fc2e-40a7-bf83-dcbf60dfbfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:50.621201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb6150-fc2e-40a7-bf83-dcbf60dfbfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:50.621485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb6150-fc2e-40a7-bf83-dcbf60dfbfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:50.621755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb6150-fc2e-40a7-bf83-dcbf60dfbfb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:50.622663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb6150-fc2e-40a7-bf83-dcbf60dfbfb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:50.622965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb6150-fc2e-40a7-bf83-dcbf60dfbfb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:50.625050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb6150-fc2e-40a7-bf83-dcbf60dfbfb0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:50.643142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 522/1045] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:50.644172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb6150-fc2e-40a7-bf83-dcbf60dfbfb0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:50.673230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:50.674953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 524/1046] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:50.753382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb6150-fc2e-40a7-bf83-dcbf60dfbfb0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:50.786750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29b934-8ebf-4ac5-ae49-baebb3f70e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:50.787396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29b934-8ebf-4ac5-ae49-baebb3f70e71 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:50.787675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29b934-8ebf-4ac5-ae49-baebb3f70e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:50.787949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29b934-8ebf-4ac5-ae49-baebb3f70e71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:50.795743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29b934-8ebf-4ac5-ae49-baebb3f70e71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:50.797209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29b934-8ebf-4ac5-ae49-baebb3f70e71 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-2a29b934-8ebf-4ac5-ae49-baebb3f70e71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:50.808714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:50.809644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:50.816571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:50.816571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:50.816571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:50.816571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:50.816571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:50.816571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:50.816571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:50.816571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:50.816571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 523/1047] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:50.818564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4557d5-83e7-4122-a78f-84bebf25cbd6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:50.843085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29b934-8ebf-4ac5-ae49-baebb3f70e71 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:50.868410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:50.928364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4557d5-83e7-4122-a78f-84bebf25cbd6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:50.937544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:50.950532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29b934-8ebf-4ac5-ae49-baebb3f70e71 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:50.963400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb254bd-a769-487f-90a0-be0051e634d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:50.964005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb254bd-a769-487f-90a0-be0051e634d4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:50.964286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb254bd-a769-487f-90a0-be0051e634d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:50.964562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb254bd-a769-487f-90a0-be0051e634d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:50.965282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb254bd-a769-487f-90a0-be0051e634d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:50.965590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb254bd-a769-487f-90a0-be0051e634d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:50.967015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb254bd-a769-487f-90a0-be0051e634d4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:50.978823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 525/1048] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:50.979595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb254bd-a769-487f-90a0-be0051e634d4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:50.989672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90fe10-a5ac-458b-a9e0-36e09a13d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:50.990297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90fe10-a5ac-458b-a9e0-36e09a13d496 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:50.990576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90fe10-a5ac-458b-a9e0-36e09a13d496 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:50.990842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90fe10-a5ac-458b-a9e0-36e09a13d496 None admin] PATH_INFO: `/v3/services/image` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:50.991417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90fe10-a5ac-458b-a9e0-36e09a13d496 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:50.993370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90fe10-a5ac-458b-a9e0-36e09a13d496 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-eb90fe10-a5ac-458b-a9e0-36e09a13d496 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:51.002017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:51.003199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:51.004573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 524/1049] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Sep 26 10:20:50 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:51.005432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90fe10-a5ac-458b-a9e0-36e09a13d496 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:51.080068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb254bd-a769-487f-90a0-be0051e634d4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:51.082370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:51.103984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90fe10-a5ac-458b-a9e0-36e09a13d496 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:51.113898 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e22ff-c378-468a-a8b3-d43c9973690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:51.114538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e22ff-c378-468a-a8b3-d43c9973690c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:51.114819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e22ff-c378-468a-a8b3-d43c9973690c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:51.115094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e22ff-c378-468a-a8b3-d43c9973690c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:51.127457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e22ff-c378-468a-a8b3-d43c9973690c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-3a5e22ff-c378-468a-a8b3-d43c9973690c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:51.132308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:51.133409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 526/1050] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:51.135755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e22ff-c378-468a-a8b3-d43c9973690c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:51.145411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299fbb4-bbc0-41cb-99e6-671d3683bf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:51.146026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299fbb4-bbc0-41cb-99e6-671d3683bf61 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:51.146306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299fbb4-bbc0-41cb-99e6-671d3683bf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:51.146578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299fbb4-bbc0-41cb-99e6-671d3683bf61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:51.147482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299fbb4-bbc0-41cb-99e6-671d3683bf61 None admin] RBAC: Adding query filter params (role.id=7b5b4b92aecb413e92b114c40fdff615, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=e58300ef26a547028e837ba2da615991) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:51.147804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299fbb4-bbc0-41cb-99e6-671d3683bf61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:51.149270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299fbb4-bbc0-41cb-99e6-671d3683bf61 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:51.154926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 525/1051] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:51 2022] GET /identity/v3/role_assignments?user.id=e58300ef26a547028e837ba2da615991&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=7b5b4b92aecb413e92b114c40fdff615 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:51.155691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299fbb4-bbc0-41cb-99e6-671d3683bf61 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:51.176776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:51.250866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e22ff-c378-468a-a8b3-d43c9973690c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:51.270007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299fbb4-bbc0-41cb-99e6-671d3683bf61 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:51.287720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc60ad-d7a4-420c-8e72-47a5e0109536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:51.288335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc60ad-d7a4-420c-8e72-47a5e0109536 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:51.288679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc60ad-d7a4-420c-8e72-47a5e0109536 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:51.288964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc60ad-d7a4-420c-8e72-47a5e0109536 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:51.290111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc60ad-d7a4-420c-8e72-47a5e0109536 None admin] RBAC: Adding query filter params (name=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:51.290409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc60ad-d7a4-420c-8e72-47a5e0109536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:51.291811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc60ad-d7a4-420c-8e72-47a5e0109536 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:51.302084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 527/1052] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:51.303369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc60ad-d7a4-420c-8e72-47a5e0109536 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:51.309336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bd914-f502-4b96-b13d-92ab24024b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:51.310010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bd914-f502-4b96-b13d-92ab24024b78 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:51.310234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bd914-f502-4b96-b13d-92ab24024b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:51.310501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bd914-f502-4b96-b13d-92ab24024b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:51.311166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bd914-f502-4b96-b13d-92ab24024b78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:51.311467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bd914-f502-4b96-b13d-92ab24024b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:51.312837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bd914-f502-4b96-b13d-92ab24024b78 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:51.323227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 526/1053] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:20:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:51.329115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bd914-f502-4b96-b13d-92ab24024b78 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:51.336532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:51.415893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:51.422502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc60ad-d7a4-420c-8e72-47a5e0109536 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:51.441862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bd914-f502-4b96-b13d-92ab24024b78 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:51.458298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9a7d2-c58d-4271-a93a-9e614d79b98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:51.458709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a7d2-c58d-4271-a93a-9e614d79b98d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:51.458988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a7d2-c58d-4271-a93a-9e614d79b98d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:51.459259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a7d2-c58d-4271-a93a-9e614d79b98d None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:51.459881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9a7d2-c58d-4271-a93a-9e614d79b98d None admin] RBAC: Adding query filter params (type=image) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:51.460182 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9a7d2-c58d-4271-a93a-9e614d79b98d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:51.462088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9a7d2-c58d-4271-a93a-9e614d79b98d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:51.467462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 528/1054] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:51.472922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9a7d2-c58d-4271-a93a-9e614d79b98d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:51.479869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413faae7-69fe-4ad0-811d-bf8e9b681f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:51.480502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413faae7-69fe-4ad0-811d-bf8e9b681f68 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:51.480782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413faae7-69fe-4ad0-811d-bf8e9b681f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:51.481081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413faae7-69fe-4ad0-811d-bf8e9b681f68 None admin] PATH_INFO: `/v3/users/8bc6e3f758f6460fabf634778e607f37` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:51.496537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413faae7-69fe-4ad0-811d-bf8e9b681f68 None admin] RBAC: Authorizing `identity:get_user(user_id=8bc6e3f758f6460fabf634778e607f37)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:51.498024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413faae7-69fe-4ad0-811d-bf8e9b681f68 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:51.500017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 527/1055] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:20:51 2022] GET /identity/v3/users/8bc6e3f758f6460fabf634778e607f37 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:51.505300 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413faae7-69fe-4ad0-811d-bf8e9b681f68 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:51.570871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:51.580806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9a7d2-c58d-4271-a93a-9e614d79b98d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:51.608247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413faae7-69fe-4ad0-811d-bf8e9b681f68 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:51.620056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481c2ae-5b3a-4948-9475-5d9e8dcd0cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:51.620687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481c2ae-5b3a-4948-9475-5d9e8dcd0cc1 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:51.621299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481c2ae-5b3a-4948-9475-5d9e8dcd0cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:51.621570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481c2ae-5b3a-4948-9475-5d9e8dcd0cc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:51.622248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481c2ae-5b3a-4948-9475-5d9e8dcd0cc1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:51.623619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481c2ae-5b3a-4948-9475-5d9e8dcd0cc1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:51.645296 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 529/1056] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:20:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:20:51.663905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd507b-1d04-4e29-b2f5-1110c126ea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:51.665206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd507b-1d04-4e29-b2f5-1110c126ea14 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:51.665491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd507b-1d04-4e29-b2f5-1110c126ea14 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:51.665763 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd507b-1d04-4e29-b2f5-1110c126ea14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:51.675468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:51.741334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd507b-1d04-4e29-b2f5-1110c126ea14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:51.742829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd507b-1d04-4e29-b2f5-1110c126ea14 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:51.849981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 528/1057] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 10:20:51.856361 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481c2ae-5b3a-4948-9475-5d9e8dcd0cc1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:51.959977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481c2ae-5b3a-4948-9475-5d9e8dcd0cc1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:51.994104 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31517b00-6d38-4b89-9c3d-003eb36886b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:51.994732 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31517b00-6d38-4b89-9c3d-003eb36886b4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:51.995012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31517b00-6d38-4b89-9c3d-003eb36886b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:51.995340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31517b00-6d38-4b89-9c3d-003eb36886b4 None admin] PATH_INFO: `/v3/projects/3974bd038bad401ea38236dea8eb3338` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:51.996461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31517b00-6d38-4b89-9c3d-003eb36886b4 None admin] RBAC: Authorizing `identity:get_project(project_id=3974bd038bad401ea38236dea8eb3338)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:51.997918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31517b00-6d38-4b89-9c3d-003eb36886b4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:51.999707 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 530/1058] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:20:51 2022] GET /identity/v3/projects/3974bd038bad401ea38236dea8eb3338 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:52.005924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd507b-1d04-4e29-b2f5-1110c126ea14 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:52.041012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:52.110182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd507b-1d04-4e29-b2f5-1110c126ea14 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:52.144108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b72df6-45f6-4d85-a80a-9991c87882ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:52.144712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b72df6-45f6-4d85-a80a-9991c87882ae None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:52.145013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b72df6-45f6-4d85-a80a-9991c87882ae None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:52.145293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b72df6-45f6-4d85-a80a-9991c87882ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:52.146004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b72df6-45f6-4d85-a80a-9991c87882ae None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=3974bd038bad401ea38236dea8eb3338, user.id=8bc6e3f758f6460fabf634778e607f37) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:52.146310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b72df6-45f6-4d85-a80a-9991c87882ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:52.147708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b72df6-45f6-4d85-a80a-9991c87882ae None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:52.157019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 529/1059] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:52 2022] GET /identity/v3/role_assignments?user.id=8bc6e3f758f6460fabf634778e607f37&scope.project.id=3974bd038bad401ea38236dea8eb3338&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:53.296860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfbda-e6b7-40ed-882d-7b3d5cd92799 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:53.297420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfbda-e6b7-40ed-882d-7b3d5cd92799 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:53.297420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfbda-e6b7-40ed-882d-7b3d5cd92799 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:53.298923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 531/1060] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:53.303762 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5f477-fd3b-48cc-8500-834bc8a6b3fc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:53.304136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5f477-fd3b-48cc-8500-834bc8a6b3fc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:53.304308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5f477-fd3b-48cc-8500-834bc8a6b3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:53.322837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-81a5f477-fd3b-48cc-8500-834bc8a6b3fc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:53.323996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-81a5f477-fd3b-48cc-8500-834bc8a6b3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:53.399003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 530/1061] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:53.665188 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebfbda-e6b7-40ed-882d-7b3d5cd92799 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:53.684187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:53.774169 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebfbda-e6b7-40ed-882d-7b3d5cd92799 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:53.810129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62795e3d-0d06-4473-8af4-d48bdcc5817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:53.810764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62795e3d-0d06-4473-8af4-d48bdcc5817e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:53.811045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62795e3d-0d06-4473-8af4-d48bdcc5817e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:53.811318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62795e3d-0d06-4473-8af4-d48bdcc5817e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:53.822687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62795e3d-0d06-4473-8af4-d48bdcc5817e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-62795e3d-0d06-4473-8af4-d48bdcc5817e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:53.827495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:53.828383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:53.829275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 532/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 10:20:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:53.834933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5f477-fd3b-48cc-8500-834bc8a6b3fc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:53.861141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:53.886060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb920-f061-4dfe-b06a-63057f0efc0a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:53.886427 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb920-f061-4dfe-b06a-63057f0efc0a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:53.886705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb920-f061-4dfe-b06a-63057f0efc0a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:53.888027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 533/1063] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:53.893130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ccf31-b6bb-4c62-ab6f-7cba365e0cb6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:53.893417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ccf31-b6bb-4c62-ab6f-7cba365e0cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:53.893695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ccf31-b6bb-4c62-ab6f-7cba365e0cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:53.913242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a70ccf31-b6bb-4c62-ab6f-7cba365e0cb6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:53.915046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a70ccf31-b6bb-4c62-ab6f-7cba365e0cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:53.941717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5f477-fd3b-48cc-8500-834bc8a6b3fc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:53.979100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57b15d-c99f-4e81-8e69-e0af534fd683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:53.980089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57b15d-c99f-4e81-8e69-e0af534fd683 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:53.980556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57b15d-c99f-4e81-8e69-e0af534fd683 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:53.981078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57b15d-c99f-4e81-8e69-e0af534fd683 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:53.981922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57b15d-c99f-4e81-8e69-e0af534fd683 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:53.982410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57b15d-c99f-4e81-8e69-e0af534fd683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:53.982645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 534/1064] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:20:53.984294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57b15d-c99f-4e81-8e69-e0af534fd683 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:53.993631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 531/1065] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 10:20:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:53.999277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ccf31-b6bb-4c62-ab6f-7cba365e0cb6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:54.011025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:54.104323 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ccf31-b6bb-4c62-ab6f-7cba365e0cb6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:54.137965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c6fdc-8428-40ca-a442-99ec40933124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:54.138592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c6fdc-8428-40ca-a442-99ec40933124 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:54.138871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c6fdc-8428-40ca-a442-99ec40933124 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:54.139142 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c6fdc-8428-40ca-a442-99ec40933124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:54.149200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c6fdc-8428-40ca-a442-99ec40933124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:54.150629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c6fdc-8428-40ca-a442-99ec40933124 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5f4c6fdc-8428-40ca-a442-99ec40933124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:54.165826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:54.166740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:54.167633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:54.167633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:54.167633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:54.169317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 535/1066] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:54.172623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57b15d-c99f-4e81-8e69-e0af534fd683 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:54.257848 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c6fdc-8428-40ca-a442-99ec40933124 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:54.267716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:54.281798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57b15d-c99f-4e81-8e69-e0af534fd683 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:54.316877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec387bf-9db0-4d0b-bdb1-88718bbbb0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:54.317597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec387bf-9db0-4d0b-bdb1-88718bbbb0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:54.318036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec387bf-9db0-4d0b-bdb1-88718bbbb0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:54.318036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec387bf-9db0-4d0b-bdb1-88718bbbb0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:54.318654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec387bf-9db0-4d0b-bdb1-88718bbbb0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:54.318956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec387bf-9db0-4d0b-bdb1-88718bbbb0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:54.319652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:54.320337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec387bf-9db0-4d0b-bdb1-88718bbbb0a1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:54.332427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 532/1067] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:54.333657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9589a-44c1-48c4-9487-32fce6036560 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:54.333941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9589a-44c1-48c4-9487-32fce6036560 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:54.334214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9589a-44c1-48c4-9487-32fce6036560 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:54.335559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 533/1068] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:54.340460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9589a-44c1-48c4-9487-32fce6036560 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:54.364015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c6fdc-8428-40ca-a442-99ec40933124 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:54.397097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f457ed2-8331-430c-96ff-c4c288158fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:54.397724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457ed2-8331-430c-96ff-c4c288158fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:54.398005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457ed2-8331-430c-96ff-c4c288158fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:54.398283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457ed2-8331-430c-96ff-c4c288158fb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:54.444679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9589a-44c1-48c4-9487-32fce6036560 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:54.471681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f457ed2-8331-430c-96ff-c4c288158fb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:54.473144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f457ed2-8331-430c-96ff-c4c288158fb4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:54.478973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dd1bb-d905-4d82-80e8-707fcd12857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:54.479593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dd1bb-d905-4d82-80e8-707fcd12857f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:54.479873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dd1bb-d905-4d82-80e8-707fcd12857f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:54.480146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dd1bb-d905-4d82-80e8-707fcd12857f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:54.486980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dd1bb-d905-4d82-80e8-707fcd12857f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:54.488377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dd1bb-d905-4d82-80e8-707fcd12857f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-052dd1bb-d905-4d82-80e8-707fcd12857f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:54.499622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:54.500743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 534/1069] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 10:20:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e36907-198c-4850-ab3e-e64e27a48177 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:54.502121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e36907-198c-4850-ab3e-e64e27a48177 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:54.502939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e36907-198c-4850-ab3e-e64e27a48177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:54.519059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-90e36907-198c-4850-ab3e-e64e27a48177 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:54.520167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-90e36907-198c-4850-ab3e-e64e27a48177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:54.522117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:54.535583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:54.576917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 536/1070] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:20:54.577963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f457ed2-8331-430c-96ff-c4c288158fb4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:54.588350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 535/1071] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:54.589207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e36907-198c-4850-ab3e-e64e27a48177 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:54.691201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e36907-198c-4850-ab3e-e64e27a48177 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:54.698524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f457ed2-8331-430c-96ff-c4c288158fb4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:54.725563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b94add-76d9-4e44-954d-737ae9e1cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:54.726178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b94add-76d9-4e44-954d-737ae9e1cb6c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:54.727051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b94add-76d9-4e44-954d-737ae9e1cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:54.727266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b94add-76d9-4e44-954d-737ae9e1cb6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:54.734156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:54.736917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc10748-9877-4d4f-b5cc-fd40c9376db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:54.737724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc10748-9877-4d4f-b5cc-fd40c9376db0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:54.738008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc10748-9877-4d4f-b5cc-fd40c9376db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:54.738284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc10748-9877-4d4f-b5cc-fd40c9376db0 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:54.738919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b94add-76d9-4e44-954d-737ae9e1cb6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:54.739021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc10748-9877-4d4f-b5cc-fd40c9376db0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:54.739309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc10748-9877-4d4f-b5cc-fd40c9376db0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:54.740344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b94add-76d9-4e44-954d-737ae9e1cb6c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:54.740719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc10748-9877-4d4f-b5cc-fd40c9376db0 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-21b94add-76d9-4e44-954d-737ae9e1cb6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:54.756699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:54.757687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:54.758630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:54.758630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:54.758630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:54.764280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 537/1072] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 10:20:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:54.764413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 536/1073] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:54.764508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc10748-9877-4d4f-b5cc-fd40c9376db0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:54.764913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b94add-76d9-4e44-954d-737ae9e1cb6c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:54.782354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:54.871766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc10748-9877-4d4f-b5cc-fd40c9376db0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:54.874933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b94add-76d9-4e44-954d-737ae9e1cb6c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:54.905642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272b14a-21f1-4f61-9f1b-d349a72a0834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:54.906241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272b14a-21f1-4f61-9f1b-d349a72a0834 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:54.906518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272b14a-21f1-4f61-9f1b-d349a72a0834 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:54.906786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272b14a-21f1-4f61-9f1b-d349a72a0834 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:54.907422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272b14a-21f1-4f61-9f1b-d349a72a0834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:54.907723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272b14a-21f1-4f61-9f1b-d349a72a0834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:54.909115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272b14a-21f1-4f61-9f1b-d349a72a0834 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:54.909327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f7286-6919-486a-9c5c-8097eb499fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:54.909940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7286-6919-486a-9c5c-8097eb499fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:54.910216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7286-6919-486a-9c5c-8097eb499fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:54.910490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7286-6919-486a-9c5c-8097eb499fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:54.920198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 538/1074] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:54.920515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f7286-6919-486a-9c5c-8097eb499fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:54.921099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272b14a-21f1-4f61-9f1b-d349a72a0834 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:54.922072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f7286-6919-486a-9c5c-8097eb499fc1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-795f7286-6919-486a-9c5c-8097eb499fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:54.947920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:54.949424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:54.950842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:54.950842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:54.950842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:54.950842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 537/1075] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:54.954982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f7286-6919-486a-9c5c-8097eb499fc1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:55.005819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:55.018258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:55.044422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272b14a-21f1-4f61-9f1b-d349a72a0834 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:55.075792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f7286-6919-486a-9c5c-8097eb499fc1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:55.082369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d651e3e-a491-47b0-babe-4a3aa724973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:55.083010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651e3e-a491-47b0-babe-4a3aa724973a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:55.083288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651e3e-a491-47b0-babe-4a3aa724973a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:55.083614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651e3e-a491-47b0-babe-4a3aa724973a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:55.096088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d651e3e-a491-47b0-babe-4a3aa724973a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-1d651e3e-a491-47b0-babe-4a3aa724973a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:55.101398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:55.102367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:55.103214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 539/1076] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:55.108486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d651e3e-a491-47b0-babe-4a3aa724973a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:55.120126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ef756-137e-4985-b94a-0275ac25d792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:55.120738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef756-137e-4985-b94a-0275ac25d792 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:55.121046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef756-137e-4985-b94a-0275ac25d792 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:55.121324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef756-137e-4985-b94a-0275ac25d792 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:55.121967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ef756-137e-4985-b94a-0275ac25d792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:55.122275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ef756-137e-4985-b94a-0275ac25d792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:55.123615 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ef756-137e-4985-b94a-0275ac25d792 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:55.136924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 538/1077] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:55.143497 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ef756-137e-4985-b94a-0275ac25d792 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:55.228365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d651e3e-a491-47b0-babe-4a3aa724973a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:55.254259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ef756-137e-4985-b94a-0275ac25d792 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:55.255798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:55.263995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652febe-0cdc-46ab-b73e-459219d006dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:55.264594 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652febe-0cdc-46ab-b73e-459219d006dc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:55.264870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652febe-0cdc-46ab-b73e-459219d006dc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:55.265164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652febe-0cdc-46ab-b73e-459219d006dc None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:55.265810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652febe-0cdc-46ab-b73e-459219d006dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:55.266106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652febe-0cdc-46ab-b73e-459219d006dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:55.267451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652febe-0cdc-46ab-b73e-459219d006dc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:55.269639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:55.276669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 540/1078] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:55.282786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652febe-0cdc-46ab-b73e-459219d006dc None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:55.288327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9239b-ab63-4c51-9a26-030530151a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:55.289001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9239b-ab63-4c51-9a26-030530151a44 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:55.289274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9239b-ab63-4c51-9a26-030530151a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:55.289543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9239b-ab63-4c51-9a26-030530151a44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:55.296063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9239b-ab63-4c51-9a26-030530151a44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:55.297443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9239b-ab63-4c51-9a26-030530151a44 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-e0d9239b-ab63-4c51-9a26-030530151a44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:55.308923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:55.309959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:55.310862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:55.310862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:55.310862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:55.310862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:55.310862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:55.310862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:55.310862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:55.310862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:55.310862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 539/1079] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:55.315642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9239b-ab63-4c51-9a26-030530151a44 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:55.384259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652febe-0cdc-46ab-b73e-459219d006dc None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:55.415441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9239b-ab63-4c51-9a26-030530151a44 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:55.416729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9b864-b896-450b-abc7-a0f78b625b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:55.417376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b864-b896-450b-abc7-a0f78b625b9b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:55.417654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b864-b896-450b-abc7-a0f78b625b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:55.417929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b864-b896-450b-abc7-a0f78b625b9b None admin] PATH_INFO: `/v3/users/8bc6e3f758f6460fabf634778e607f37` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:55.419056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9b864-b896-450b-abc7-a0f78b625b9b None admin] RBAC: Authorizing `identity:get_user(user_id=8bc6e3f758f6460fabf634778e607f37)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:55.420471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9b864-b896-450b-abc7-a0f78b625b9b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:55.422065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 541/1080] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:20:55 2022] GET /identity/v3/users/8bc6e3f758f6460fabf634778e607f37 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:55.427636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9b864-b896-450b-abc7-a0f78b625b9b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:55.454334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a33716-6cd3-4871-b3f0-30a25db68b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:55.454937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a33716-6cd3-4871-b3f0-30a25db68b95 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:55.455218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a33716-6cd3-4871-b3f0-30a25db68b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:55.455492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a33716-6cd3-4871-b3f0-30a25db68b95 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:55.456174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a33716-6cd3-4871-b3f0-30a25db68b95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:55.456477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a33716-6cd3-4871-b3f0-30a25db68b95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:55.457908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a33716-6cd3-4871-b3f0-30a25db68b95 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:55.474846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 540/1081] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:55.476011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a33716-6cd3-4871-b3f0-30a25db68b95 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:55.491291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:55.499616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:55.526704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9b864-b896-450b-abc7-a0f78b625b9b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:55.562816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9bc54-99d9-4c47-bb15-4cb66bf34cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:55.563523 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9bc54-99d9-4c47-bb15-4cb66bf34cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:55.563807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9bc54-99d9-4c47-bb15-4cb66bf34cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:55.564081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9bc54-99d9-4c47-bb15-4cb66bf34cd5 None admin] PATH_INFO: `/v3/projects/3974bd038bad401ea38236dea8eb3338` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:55.565227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9bc54-99d9-4c47-bb15-4cb66bf34cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=3974bd038bad401ea38236dea8eb3338)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:55.566663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9bc54-99d9-4c47-bb15-4cb66bf34cd5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:55.568294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 542/1082] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:20:55 2022] GET /identity/v3/projects/3974bd038bad401ea38236dea8eb3338 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:55.573321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a33716-6cd3-4871-b3f0-30a25db68b95 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:55.573974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9bc54-99d9-4c47-bb15-4cb66bf34cd5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:55.606455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e23881-aba6-422e-9628-ba3fc17cac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:55.607104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23881-aba6-422e-9628-ba3fc17cac01 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:55.607381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23881-aba6-422e-9628-ba3fc17cac01 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:55.607654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23881-aba6-422e-9628-ba3fc17cac01 None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/e58300ef26a547028e837ba2da615991/roles/7b5b4b92aecb413e92b114c40fdff615` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:55.609795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e23881-aba6-422e-9628-ba3fc17cac01 None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=e58300ef26a547028e837ba2da615991, role_id=7b5b4b92aecb413e92b114c40fdff615)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:55.611197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e23881-aba6-422e-9628-ba3fc17cac01 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:55.623903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 541/1083] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:20:55 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/e58300ef26a547028e837ba2da615991/roles/7b5b4b92aecb413e92b114c40fdff615 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:20:55.682628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9bc54-99d9-4c47-bb15-4cb66bf34cd5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:55.719162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800db7c-774c-484d-bb34-24b9c700eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:55.719836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800db7c-774c-484d-bb34-24b9c700eeeb None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:55.720117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800db7c-774c-484d-bb34-24b9c700eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:55.720396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800db7c-774c-484d-bb34-24b9c700eeeb None admin] PATH_INFO: `/v3/projects/3974bd038bad401ea38236dea8eb3338/users/8bc6e3f758f6460fabf634778e607f37/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:55.722385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800db7c-774c-484d-bb34-24b9c700eeeb None admin] RBAC: Authorizing `identity:create_grant(project_id=3974bd038bad401ea38236dea8eb3338, user_id=8bc6e3f758f6460fabf634778e607f37, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:55.723830 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800db7c-774c-484d-bb34-24b9c700eeeb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:55.726232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:55.738479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 543/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:20:55 2022] PUT /identity/v3/projects/3974bd038bad401ea38236dea8eb3338/users/8bc6e3f758f6460fabf634778e607f37/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:20:57.750398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76825c-ad65-4da4-93c9-b4d0b1316aad None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:57.750951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76825c-ad65-4da4-93c9-b4d0b1316aad None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:57.750951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76825c-ad65-4da4-93c9-b4d0b1316aad None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:57.752200 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 542/1085] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:57.758815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf71d81-c3e4-4801-85aa-b47c78ea9946 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:57.759385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf71d81-c3e4-4801-85aa-b47c78ea9946 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:57.759487 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf71d81-c3e4-4801-85aa-b47c78ea9946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:57.780174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-adf71d81-c3e4-4801-85aa-b47c78ea9946 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:57.781445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-adf71d81-c3e4-4801-85aa-b47c78ea9946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:57.847172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 544/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:57.876606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79722c-06b9-482c-a8b0-b4fc6ae31891 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:57.876892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79722c-06b9-482c-a8b0-b4fc6ae31891 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:57.877202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79722c-06b9-482c-a8b0-b4fc6ae31891 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:57.878517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 543/1087] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:20:57.884456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c24686-58d9-4eef-9e73-9637c345a69a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:57.884747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c24686-58d9-4eef-9e73-9637c345a69a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:57.885055 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c24686-58d9-4eef-9e73-9637c345a69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:57.903438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-34c24686-58d9-4eef-9e73-9637c345a69a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:20:57.904620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-34c24686-58d9-4eef-9e73-9637c345a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:20:57.967561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 545/1088] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:20:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:20:58.112255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79722c-06b9-482c-a8b0-b4fc6ae31891 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:58.191934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:58.213864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79722c-06b9-482c-a8b0-b4fc6ae31891 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:58.242294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c24686-58d9-4eef-9e73-9637c345a69a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:58.247540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a34a2-431d-42f2-b409-c23b33e3c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:58.248169 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a34a2-431d-42f2-b409-c23b33e3c85f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:58.248450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a34a2-431d-42f2-b409-c23b33e3c85f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:58.248735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a34a2-431d-42f2-b409-c23b33e3c85f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:58.258854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a34a2-431d-42f2-b409-c23b33e3c85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b25a34a2-431d-42f2-b409-c23b33e3c85f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:58.263605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:58.264670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:58.265608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 544/1089] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 10:20:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:58.270521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a34a2-431d-42f2-b409-c23b33e3c85f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:58.296849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:58.342771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c24686-58d9-4eef-9e73-9637c345a69a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:58.375305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a34a2-431d-42f2-b409-c23b33e3c85f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:58.377100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6193a07-5116-4256-94f2-b09e64078f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:58.377731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6193a07-5116-4256-94f2-b09e64078f25 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:58.378011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6193a07-5116-4256-94f2-b09e64078f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:58.378287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6193a07-5116-4256-94f2-b09e64078f25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:58.388291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6193a07-5116-4256-94f2-b09e64078f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e6193a07-5116-4256-94f2-b09e64078f25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:20:58.393145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:58.394191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:58.395430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 546/1090] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:58.400516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6193a07-5116-4256-94f2-b09e64078f25 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:58.408855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643e3bc-ceb9-424d-9c54-6028526861c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:58.409488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643e3bc-ceb9-424d-9c54-6028526861c0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:58.409768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643e3bc-ceb9-424d-9c54-6028526861c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:58.410037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643e3bc-ceb9-424d-9c54-6028526861c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:58.410694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643e3bc-ceb9-424d-9c54-6028526861c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:58.410998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643e3bc-ceb9-424d-9c54-6028526861c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:58.412330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643e3bc-ceb9-424d-9c54-6028526861c0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:58.420155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 545/1091] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 10:20:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:58.425864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643e3bc-ceb9-424d-9c54-6028526861c0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:58.430173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:58.501066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6193a07-5116-4256-94f2-b09e64078f25 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:58.515214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:58.523612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643e3bc-ceb9-424d-9c54-6028526861c0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:58.535502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fb32c-b580-45b2-8e9d-1a63e94e685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:58.536103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb32c-b580-45b2-8e9d-1a63e94e685e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:58.536380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb32c-b580-45b2-8e9d-1a63e94e685e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:58.536649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb32c-b580-45b2-8e9d-1a63e94e685e None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:58.537327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fb32c-b580-45b2-8e9d-1a63e94e685e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:58.537625 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fb32c-b580-45b2-8e9d-1a63e94e685e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:58.539455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fb32c-b580-45b2-8e9d-1a63e94e685e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:58.547209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 547/1092] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:20:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:58.552941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fb32c-b580-45b2-8e9d-1a63e94e685e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:58.557582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8500cd1-4ed7-48f0-b470-eea102dedc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:58.558198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8500cd1-4ed7-48f0-b470-eea102dedc7b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:58.558480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8500cd1-4ed7-48f0-b470-eea102dedc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:58.558748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8500cd1-4ed7-48f0-b470-eea102dedc7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:58.568968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8500cd1-4ed7-48f0-b470-eea102dedc7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:58.570431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8500cd1-4ed7-48f0-b470-eea102dedc7b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-b8500cd1-4ed7-48f0-b470-eea102dedc7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:58.584190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:58.585470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:58.586599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:58.586599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:58.586599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:58.586599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 546/1093] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:58.591385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8500cd1-4ed7-48f0-b470-eea102dedc7b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:58.645403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:58.654183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fb32c-b580-45b2-8e9d-1a63e94e685e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:58.687391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd8983-0d1f-4f26-82a4-e3dc103ba365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:58.688033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd8983-0d1f-4f26-82a4-e3dc103ba365 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:58.688320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd8983-0d1f-4f26-82a4-e3dc103ba365 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:58.688593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd8983-0d1f-4f26-82a4-e3dc103ba365 None admin] PATH_INFO: `/v3/users/8bc6e3f758f6460fabf634778e607f37` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:58.688905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8500cd1-4ed7-48f0-b470-eea102dedc7b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:58.689753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd8983-0d1f-4f26-82a4-e3dc103ba365 None admin] RBAC: Authorizing `identity:get_user(user_id=8bc6e3f758f6460fabf634778e607f37)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:58.691176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd8983-0d1f-4f26-82a4-e3dc103ba365 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:58.692750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 548/1094] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:20:58 2022] GET /identity/v3/users/8bc6e3f758f6460fabf634778e607f37 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:58.698426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd8983-0d1f-4f26-82a4-e3dc103ba365 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:58.721197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaf2ac-b0a5-435a-be2b-6db215f1db68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:58.721800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf2ac-b0a5-435a-be2b-6db215f1db68 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:58.722078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf2ac-b0a5-435a-be2b-6db215f1db68 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:58.722352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf2ac-b0a5-435a-be2b-6db215f1db68 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:58.722986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaf2ac-b0a5-435a-be2b-6db215f1db68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:58.723292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaf2ac-b0a5-435a-be2b-6db215f1db68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:58.724634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaf2ac-b0a5-435a-be2b-6db215f1db68 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:58.736740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 547/1095] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:58.742835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaf2ac-b0a5-435a-be2b-6db215f1db68 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:58.744101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:58.797872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd8983-0d1f-4f26-82a4-e3dc103ba365 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:58.831254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cdcb-87ba-447b-9950-3ada3ec1fc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:58.831862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cdcb-87ba-447b-9950-3ada3ec1fc43 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:58.832144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cdcb-87ba-447b-9950-3ada3ec1fc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:58.832429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cdcb-87ba-447b-9950-3ada3ec1fc43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:58.838655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaf2ac-b0a5-435a-be2b-6db215f1db68 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:58.856137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:58.874882 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26591b4-b5b9-4a52-b945-a996c3dca67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:58.875496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26591b4-b5b9-4a52-b945-a996c3dca67e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:58.875774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26591b4-b5b9-4a52-b945-a996c3dca67e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:58.876040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26591b4-b5b9-4a52-b945-a996c3dca67e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:58.882804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26591b4-b5b9-4a52-b945-a996c3dca67e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:58.884224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26591b4-b5b9-4a52-b945-a996c3dca67e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a26591b4-b5b9-4a52-b945-a996c3dca67e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:20:58.895498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:58.896647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:20:58.897661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 548/1096] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 10:20:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:20:58.899356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656cdcb-87ba-447b-9950-3ada3ec1fc43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:58.900852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656cdcb-87ba-447b-9950-3ada3ec1fc43 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:58.902874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26591b4-b5b9-4a52-b945-a996c3dca67e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:58.943620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:58.998676 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 549/1097] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 10:20:59.001202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26591b4-b5b9-4a52-b945-a996c3dca67e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:59.004226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cdcb-87ba-447b-9950-3ada3ec1fc43 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:59.034807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2942df-147e-4020-aa2b-fdec5687f00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:59.035406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2942df-147e-4020-aa2b-fdec5687f00b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:59.035689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2942df-147e-4020-aa2b-fdec5687f00b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:59.035961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2942df-147e-4020-aa2b-fdec5687f00b None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:59.036680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2942df-147e-4020-aa2b-fdec5687f00b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:59.037008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2942df-147e-4020-aa2b-fdec5687f00b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:59.038422 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2942df-147e-4020-aa2b-fdec5687f00b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:59.055233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 549/1098] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 10:20:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:59.060802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2942df-147e-4020-aa2b-fdec5687f00b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:59.092450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:59.104892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cdcb-87ba-447b-9950-3ada3ec1fc43 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:59.137702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c164f8-476f-45fc-882f-9c7c4d676b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:59.138324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c164f8-476f-45fc-882f-9c7c4d676b82 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:59.138604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c164f8-476f-45fc-882f-9c7c4d676b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:59.138881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c164f8-476f-45fc-882f-9c7c4d676b82 None admin] PATH_INFO: `/v3/projects/3974bd038bad401ea38236dea8eb3338` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:59.139982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c164f8-476f-45fc-882f-9c7c4d676b82 None admin] RBAC: Authorizing `identity:get_project(project_id=3974bd038bad401ea38236dea8eb3338)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:59.141471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c164f8-476f-45fc-882f-9c7c4d676b82 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:59.143081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 550/1099] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:20:59 2022] GET /identity/v3/projects/3974bd038bad401ea38236dea8eb3338 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:59.149543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c164f8-476f-45fc-882f-9c7c4d676b82 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:59.156933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2942df-147e-4020-aa2b-fdec5687f00b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:59.163400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:59.190327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcedd-06cc-40ca-b5ca-9590db36e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:59.190928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcedd-06cc-40ca-b5ca-9590db36e99b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:59.191206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcedd-06cc-40ca-b5ca-9590db36e99b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:59.191478 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcedd-06cc-40ca-b5ca-9590db36e99b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:59.250268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c164f8-476f-45fc-882f-9c7c4d676b82 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:59.260467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfcedd-06cc-40ca-b5ca-9590db36e99b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:59.261974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfcedd-06cc-40ca-b5ca-9590db36e99b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:59.284824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ff5da-6756-41fa-b05c-17d0a3dccf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:59.285457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ff5da-6756-41fa-b05c-17d0a3dccf42 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:59.285736 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ff5da-6756-41fa-b05c-17d0a3dccf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:59.286013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ff5da-6756-41fa-b05c-17d0a3dccf42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:59.286726 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ff5da-6756-41fa-b05c-17d0a3dccf42 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=3974bd038bad401ea38236dea8eb3338, user.id=8bc6e3f758f6460fabf634778e607f37) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:59.287034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ff5da-6756-41fa-b05c-17d0a3dccf42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:59.288437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ff5da-6756-41fa-b05c-17d0a3dccf42 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:59.294019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 551/1100] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:20:59 2022] GET /identity/v3/role_assignments?user.id=8bc6e3f758f6460fabf634778e607f37&scope.project.id=3974bd038bad401ea38236dea8eb3338&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:20:59.297393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:59.374888 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 550/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:20:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 10:20:59.380859 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ff5da-6756-41fa-b05c-17d0a3dccf42 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:59.462212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:59.487559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ff5da-6756-41fa-b05c-17d0a3dccf42 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:59.521122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398b7fb-ebff-41dd-8586-52dc6a073427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:59.521753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398b7fb-ebff-41dd-8586-52dc6a073427 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:59.522033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398b7fb-ebff-41dd-8586-52dc6a073427 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:59.522306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398b7fb-ebff-41dd-8586-52dc6a073427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:59.533641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398b7fb-ebff-41dd-8586-52dc6a073427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:59.535077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398b7fb-ebff-41dd-8586-52dc6a073427 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b398b7fb-ebff-41dd-8586-52dc6a073427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:20:59.548798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:59.549931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:20:59.550813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:20:59.550813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:20:59.550813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:59.550813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 552/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:59.555559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcedd-06cc-40ca-b5ca-9590db36e99b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:59.654938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcedd-06cc-40ca-b5ca-9590db36e99b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:59.688331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916027b8-cdd7-496e-9cd8-8463a3816ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:59.688926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916027b8-cdd7-496e-9cd8-8463a3816ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:59.689230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916027b8-cdd7-496e-9cd8-8463a3816ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:59.689500 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916027b8-cdd7-496e-9cd8-8463a3816ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:59.690134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916027b8-cdd7-496e-9cd8-8463a3816ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:20:59.690433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916027b8-cdd7-496e-9cd8-8463a3816ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:59.691770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916027b8-cdd7-496e-9cd8-8463a3816ce3 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:59.693213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:59.704166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 551/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:20:59.709760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398b7fb-ebff-41dd-8586-52dc6a073427 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:59.812311 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398b7fb-ebff-41dd-8586-52dc6a073427 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:20:59.837755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:20:59.845795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c425356-4e4b-4429-83d5-eeecacaed6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:20:59.846423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c425356-4e4b-4429-83d5-eeecacaed6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:20:59.846700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c425356-4e4b-4429-83d5-eeecacaed6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:20:59.846971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c425356-4e4b-4429-83d5-eeecacaed6c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:20:59.853456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c425356-4e4b-4429-83d5-eeecacaed6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:20:59.854879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c425356-4e4b-4429-83d5-eeecacaed6c4 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2c425356-4e4b-4429-83d5-eeecacaed6c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:20:59.865854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:20:59.866896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:20:59.868316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:20:59.868316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:20:59.868316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:20:59.868316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:20:59.868316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:20:59.868316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:20:59.868316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:20:59.868316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:20:59.868316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 553/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:20:59.873412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916027b8-cdd7-496e-9cd8-8463a3816ce3 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:20:59.970861 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916027b8-cdd7-496e-9cd8-8463a3816ce3 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:00.004120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba810f27-4df8-4c74-bb42-dde005e26c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:00.004719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810f27-4df8-4c74-bb42-dde005e26c62 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:00.005027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810f27-4df8-4c74-bb42-dde005e26c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:00.005301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810f27-4df8-4c74-bb42-dde005e26c62 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:00.005978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810f27-4df8-4c74-bb42-dde005e26c62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:00.006280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810f27-4df8-4c74-bb42-dde005e26c62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:00.007714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810f27-4df8-4c74-bb42-dde005e26c62 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:00.020174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 552/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:00.026189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c425356-4e4b-4429-83d5-eeecacaed6c4 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:00.123840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c425356-4e4b-4429-83d5-eeecacaed6c4 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:00.157231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05667d91-b2c9-4105-9c7e-466695d7341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:00.157826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05667d91-b2c9-4105-9c7e-466695d7341d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:00.158104 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05667d91-b2c9-4105-9c7e-466695d7341d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:00.158374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05667d91-b2c9-4105-9c7e-466695d7341d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:00.159085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05667d91-b2c9-4105-9c7e-466695d7341d None admin] RBAC: Adding query filter params (role.id=7b5b4b92aecb413e92b114c40fdff615, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=e58300ef26a547028e837ba2da615991) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:00.159392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05667d91-b2c9-4105-9c7e-466695d7341d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:00.160831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05667d91-b2c9-4105-9c7e-466695d7341d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:00.166500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 554/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:21:00 2022] GET /identity/v3/role_assignments?user.id=e58300ef26a547028e837ba2da615991&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=7b5b4b92aecb413e92b114c40fdff615 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:21:01.456715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffb63-6c3f-4847-a36d-7eafabddd010 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:01.457283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffb63-6c3f-4847-a36d-7eafabddd010 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:01.457283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffb63-6c3f-4847-a36d-7eafabddd010 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:01.458612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 553/1107] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:01.464371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d39bfd-d967-4a9f-953e-2ba403ea039a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:01.464753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d39bfd-d967-4a9f-953e-2ba403ea039a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:01.464922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d39bfd-d967-4a9f-953e-2ba403ea039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:01.482749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-38d39bfd-d967-4a9f-953e-2ba403ea039a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:01.483929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-38d39bfd-d967-4a9f-953e-2ba403ea039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:01.529939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:01.549395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 555/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:01.817124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edffb63-6c3f-4847-a36d-7eafabddd010 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:01.872224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:01.919288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edffb63-6c3f-4847-a36d-7eafabddd010 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:01.952511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3971abb-1102-461f-8dc9-7ff1d2a51b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:01.953150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3971abb-1102-461f-8dc9-7ff1d2a51b12 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:01.953431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3971abb-1102-461f-8dc9-7ff1d2a51b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:01.953701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3971abb-1102-461f-8dc9-7ff1d2a51b12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:01.954795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3971abb-1102-461f-8dc9-7ff1d2a51b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:01.956209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3971abb-1102-461f-8dc9-7ff1d2a51b12 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:01.957798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 554/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:21:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:01.963448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d39bfd-d967-4a9f-953e-2ba403ea039a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:02.057747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d39bfd-d967-4a9f-953e-2ba403ea039a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:02.090351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5282e-6224-49bd-8c8d-d3a1b154603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:02.090942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5282e-6224-49bd-8c8d-d3a1b154603f None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:02.091222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5282e-6224-49bd-8c8d-d3a1b154603f None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:02.091495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5282e-6224-49bd-8c8d-d3a1b154603f None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:02.092140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5282e-6224-49bd-8c8d-d3a1b154603f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:02.093583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5282e-6224-49bd-8c8d-d3a1b154603f None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:02.113954 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 556/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:21:01 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:21:04.293534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb562d8-3dde-48c0-874d-bb68c98dfbfb None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:04.294090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb562d8-3dde-48c0-874d-bb68c98dfbfb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:04.294090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb562d8-3dde-48c0-874d-bb68c98dfbfb None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:04.295415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 555/1111] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:04.300642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a01ef-bf45-4821-b9dd-da07083f59b8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:04.301048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a01ef-bf45-4821-b9dd-da07083f59b8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:04.301245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a01ef-bf45-4821-b9dd-da07083f59b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:04.318935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-eb3a01ef-bf45-4821-b9dd-da07083f59b8 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:04.320140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eb3a01ef-bf45-4821-b9dd-da07083f59b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:04.348851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:04.387078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 557/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:04.655810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb562d8-3dde-48c0-874d-bb68c98dfbfb None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:04.751945 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb562d8-3dde-48c0-874d-bb68c98dfbfb None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:04.773396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:04.785222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68c47-e690-494d-98b5-cc3f9729c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:04.785829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68c47-e690-494d-98b5-cc3f9729c37d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:04.786104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68c47-e690-494d-98b5-cc3f9729c37d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:04.786373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68c47-e690-494d-98b5-cc3f9729c37d None admin] PATH_INFO: `/v3/roles/d742575a6b40459fbb329defa3b642c5` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:04.787722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d68c47-e690-494d-98b5-cc3f9729c37d None admin] RBAC: Authorizing `identity:get_role(role_id=d742575a6b40459fbb329defa3b642c5)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:04.789105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d68c47-e690-494d-98b5-cc3f9729c37d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:04.790392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 556/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:04 2022] GET /identity/v3/roles/d742575a6b40459fbb329defa3b642c5 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:04.796049 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a01ef-bf45-4821-b9dd-da07083f59b8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:04.892780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a01ef-bf45-4821-b9dd-da07083f59b8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:04.924752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561cec7-f011-401f-a011-5b5ccaaaaf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:04.925330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561cec7-f011-401f-a011-5b5ccaaaaf21 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:04.925606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561cec7-f011-401f-a011-5b5ccaaaaf21 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:04.925873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561cec7-f011-401f-a011-5b5ccaaaaf21 None admin] PATH_INFO: `/v3/users/1abe3d8121504673b940ce30beaaaa07` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:04.938919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561cec7-f011-401f-a011-5b5ccaaaaf21 None admin] RBAC: Authorizing `identity:get_user(user_id=1abe3d8121504673b940ce30beaaaa07)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:04.940335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561cec7-f011-401f-a011-5b5ccaaaaf21 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:04.941930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 558/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:04 2022] GET /identity/v3/users/1abe3d8121504673b940ce30beaaaa07 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:04.948310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68c47-e690-494d-98b5-cc3f9729c37d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:05.045725 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68c47-e690-494d-98b5-cc3f9729c37d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:05.078136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf8b1-d280-45fc-b738-f2563ad1d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:05.078733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf8b1-d280-45fc-b738-f2563ad1d063 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:05.079017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf8b1-d280-45fc-b738-f2563ad1d063 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:05.079291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf8b1-d280-45fc-b738-f2563ad1d063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:05.133459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:05.143650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cf8b1-d280-45fc-b738-f2563ad1d063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:05.145125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cf8b1-d280-45fc-b738-f2563ad1d063 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:05.238326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 557/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:21:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 10:21:05.244679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561cec7-f011-401f-a011-5b5ccaaaaf21 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:05.270945 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:05.340125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561cec7-f011-401f-a011-5b5ccaaaaf21 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:05.373555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a35494-02b0-4c5b-8b03-3338ed0565b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:05.374176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35494-02b0-4c5b-8b03-3338ed0565b1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:05.374453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35494-02b0-4c5b-8b03-3338ed0565b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:05.374723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35494-02b0-4c5b-8b03-3338ed0565b1 None admin] PATH_INFO: `/v3/projects/3974bd038bad401ea38236dea8eb3338` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:05.375811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a35494-02b0-4c5b-8b03-3338ed0565b1 None admin] RBAC: Authorizing `identity:get_project(project_id=3974bd038bad401ea38236dea8eb3338)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:05.377249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a35494-02b0-4c5b-8b03-3338ed0565b1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:05.378854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 559/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:21:05 2022] GET /identity/v3/projects/3974bd038bad401ea38236dea8eb3338 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:05.384883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf8b1-d280-45fc-b738-f2563ad1d063 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:05.469679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:05.479311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf8b1-d280-45fc-b738-f2563ad1d063 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:05.511651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038bf8a-3387-4a4e-a0bd-1a6b3b725de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:05.512186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038bf8a-3387-4a4e-a0bd-1a6b3b725de9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:05.512465 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038bf8a-3387-4a4e-a0bd-1a6b3b725de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:05.512738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038bf8a-3387-4a4e-a0bd-1a6b3b725de9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:05.513482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038bf8a-3387-4a4e-a0bd-1a6b3b725de9 None admin] RBAC: Adding query filter params (role.id=d742575a6b40459fbb329defa3b642c5, scope.project.id=3974bd038bad401ea38236dea8eb3338, user.id=1abe3d8121504673b940ce30beaaaa07) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:05.513788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038bf8a-3387-4a4e-a0bd-1a6b3b725de9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:05.515196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038bf8a-3387-4a4e-a0bd-1a6b3b725de9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:05.520359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 558/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:21:05 2022] GET /identity/v3/role_assignments?user.id=1abe3d8121504673b940ce30beaaaa07&scope.project.id=3974bd038bad401ea38236dea8eb3338&role.id=d742575a6b40459fbb329defa3b642c5 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:07.646516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a7bb4-c8ed-4029-9b4f-6063d46a1e90 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:07.647014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a7bb4-c8ed-4029-9b4f-6063d46a1e90 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:07.647014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a7bb4-c8ed-4029-9b4f-6063d46a1e90 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:07.648322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 560/1118] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:07.654283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca565-62fa-4047-ace3-8a6fb5bfff6c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:07.654724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca565-62fa-4047-ace3-8a6fb5bfff6c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:07.654816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca565-62fa-4047-ace3-8a6fb5bfff6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:07.672837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8cbca565-62fa-4047-ace3-8a6fb5bfff6c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:07.674040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8cbca565-62fa-4047-ace3-8a6fb5bfff6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:07.738267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 559/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:08.011260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a7bb4-c8ed-4029-9b4f-6063d46a1e90 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:08.103341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:08.110897 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a7bb4-c8ed-4029-9b4f-6063d46a1e90 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:08.142818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c6ab0-9ff8-4c89-8114-9beec1380af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:08.143432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c6ab0-9ff8-4c89-8114-9beec1380af5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:08.143712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c6ab0-9ff8-4c89-8114-9beec1380af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:08.143984 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c6ab0-9ff8-4c89-8114-9beec1380af5 None admin] PATH_INFO: `/v3/roles/d742575a6b40459fbb329defa3b642c5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:08.145365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c6ab0-9ff8-4c89-8114-9beec1380af5 None admin] RBAC: Authorizing `identity:get_role(role_id=d742575a6b40459fbb329defa3b642c5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:08.146727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c6ab0-9ff8-4c89-8114-9beec1380af5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:08.148010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 561/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:08 2022] GET /identity/v3/roles/d742575a6b40459fbb329defa3b642c5 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:08.154449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbca565-62fa-4047-ace3-8a6fb5bfff6c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:08.233120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:08.248029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbca565-62fa-4047-ace3-8a6fb5bfff6c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:08.280743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8bf4f-bdb0-4b50-82cc-f709e8a2711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:08.281316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8bf4f-bdb0-4b50-82cc-f709e8a2711d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:08.281594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8bf4f-bdb0-4b50-82cc-f709e8a2711d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:08.281862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8bf4f-bdb0-4b50-82cc-f709e8a2711d None admin] PATH_INFO: `/v3/users/1abe3d8121504673b940ce30beaaaa07` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:08.282946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8bf4f-bdb0-4b50-82cc-f709e8a2711d None admin] RBAC: Authorizing `identity:get_user(user_id=1abe3d8121504673b940ce30beaaaa07)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:08.284363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8bf4f-bdb0-4b50-82cc-f709e8a2711d None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:08.285918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 560/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:08 2022] GET /identity/v3/users/1abe3d8121504673b940ce30beaaaa07 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:08.291390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c6ab0-9ff8-4c89-8114-9beec1380af5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:08.387328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c6ab0-9ff8-4c89-8114-9beec1380af5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:08.420388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f06d4-c759-4871-94eb-f05754faf5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:08.421026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f06d4-c759-4871-94eb-f05754faf5fc None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:08.421308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f06d4-c759-4871-94eb-f05754faf5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:08.421582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f06d4-c759-4871-94eb-f05754faf5fc None admin] PATH_INFO: `/v3/projects/3974bd038bad401ea38236dea8eb3338` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:08.422683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f06d4-c759-4871-94eb-f05754faf5fc None admin] RBAC: Authorizing `identity:get_project(project_id=3974bd038bad401ea38236dea8eb3338)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:08.424093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f06d4-c759-4871-94eb-f05754faf5fc None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:08.425720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 562/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:21:08 2022] GET /identity/v3/projects/3974bd038bad401ea38236dea8eb3338 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:08.431565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8bf4f-bdb0-4b50-82cc-f709e8a2711d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:08.526029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8bf4f-bdb0-4b50-82cc-f709e8a2711d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:08.557159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc08943-b157-4a8b-9bd6-12fc28692214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:08.557738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc08943-b157-4a8b-9bd6-12fc28692214 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:08.558016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc08943-b157-4a8b-9bd6-12fc28692214 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:08.558289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc08943-b157-4a8b-9bd6-12fc28692214 None admin] PATH_INFO: `/v3/projects/3974bd038bad401ea38236dea8eb3338/users/1abe3d8121504673b940ce30beaaaa07/roles/d742575a6b40459fbb329defa3b642c5` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:08.560362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc08943-b157-4a8b-9bd6-12fc28692214 None admin] RBAC: Authorizing `identity:create_grant(project_id=3974bd038bad401ea38236dea8eb3338, user_id=1abe3d8121504673b940ce30beaaaa07, role_id=d742575a6b40459fbb329defa3b642c5)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:08.561784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc08943-b157-4a8b-9bd6-12fc28692214 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:08.574362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 561/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:21:08 2022] PUT /identity/v3/projects/3974bd038bad401ea38236dea8eb3338/users/1abe3d8121504673b940ce30beaaaa07/roles/d742575a6b40459fbb329defa3b642c5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:21:10.669807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42afa99-f2b6-4585-b84f-62bc5b0dcaa1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:10.670314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42afa99-f2b6-4585-b84f-62bc5b0dcaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:10.670314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42afa99-f2b6-4585-b84f-62bc5b0dcaa1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:10.671601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 563/1124] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:10.676682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d78635-f1e4-47ca-acb8-e098b78b2dd4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:10.677125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d78635-f1e4-47ca-acb8-e098b78b2dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:10.677257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d78635-f1e4-47ca-acb8-e098b78b2dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:10.694895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-51d78635-f1e4-47ca-acb8-e098b78b2dd4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:10.696572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-51d78635-f1e4-47ca-acb8-e098b78b2dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:10.703672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:10.761484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 562/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:21:11.029092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42afa99-f2b6-4585-b84f-62bc5b0dcaa1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:11.058454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:11.127471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42afa99-f2b6-4585-b84f-62bc5b0dcaa1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:11.159970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c531b24-3a52-4046-b9f0-155017823e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:11.160576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c531b24-3a52-4046-b9f0-155017823e57 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:11.160856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c531b24-3a52-4046-b9f0-155017823e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:11.161151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c531b24-3a52-4046-b9f0-155017823e57 None admin] PATH_INFO: `/v3/roles/d742575a6b40459fbb329defa3b642c5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:11.162626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c531b24-3a52-4046-b9f0-155017823e57 None admin] RBAC: Authorizing `identity:get_role(role_id=d742575a6b40459fbb329defa3b642c5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:11.164551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c531b24-3a52-4046-b9f0-155017823e57 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:11.165908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 564/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:11 2022] GET /identity/v3/roles/d742575a6b40459fbb329defa3b642c5 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:11.171561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d78635-f1e4-47ca-acb8-e098b78b2dd4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:11.266173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d78635-f1e4-47ca-acb8-e098b78b2dd4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:11.298590 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c7ca-df79-4f5c-bf84-6fb35b9f5547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:11.299151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c7ca-df79-4f5c-bf84-6fb35b9f5547 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:11.299432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c7ca-df79-4f5c-bf84-6fb35b9f5547 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:11.299704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c7ca-df79-4f5c-bf84-6fb35b9f5547 None admin] PATH_INFO: `/v3/users/1abe3d8121504673b940ce30beaaaa07` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:11.300806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19c7ca-df79-4f5c-bf84-6fb35b9f5547 None admin] RBAC: Authorizing `identity:get_user(user_id=1abe3d8121504673b940ce30beaaaa07)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:11.302247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19c7ca-df79-4f5c-bf84-6fb35b9f5547 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:11.303786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 563/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:11 2022] GET /identity/v3/users/1abe3d8121504673b940ce30beaaaa07 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:11.309897 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c531b24-3a52-4046-b9f0-155017823e57 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:11.401780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:11.405763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c531b24-3a52-4046-b9f0-155017823e57 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:11.439081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ed94-3823-4779-b1a9-40c96a790be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:11.439668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ed94-3823-4779-b1a9-40c96a790be1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:11.439944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ed94-3823-4779-b1a9-40c96a790be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:11.440210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ed94-3823-4779-b1a9-40c96a790be1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:11.503454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3ed94-3823-4779-b1a9-40c96a790be1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:11.504863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3ed94-3823-4779-b1a9-40c96a790be1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:11.593964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:11.597978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 565/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:21:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:21:11.604442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c7ca-df79-4f5c-bf84-6fb35b9f5547 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:11.616740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:11.702409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c7ca-df79-4f5c-bf84-6fb35b9f5547 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:11.734871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a04906-68ca-40e9-9706-21978a45282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:11.735494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04906-68ca-40e9-9706-21978a45282e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:11.735772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04906-68ca-40e9-9706-21978a45282e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:11.736041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04906-68ca-40e9-9706-21978a45282e None admin] PATH_INFO: `/v3/projects/3974bd038bad401ea38236dea8eb3338` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:11.737158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a04906-68ca-40e9-9706-21978a45282e None admin] RBAC: Authorizing `identity:get_project(project_id=3974bd038bad401ea38236dea8eb3338)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:11.738564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a04906-68ca-40e9-9706-21978a45282e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:11.740162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 564/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:21:11 2022] GET /identity/v3/projects/3974bd038bad401ea38236dea8eb3338 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:11.746331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ed94-3823-4779-b1a9-40c96a790be1 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:11.840534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ed94-3823-4779-b1a9-40c96a790be1 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:11.872975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70d190-0e7b-48a4-b5c5-47f41b792f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:11.873501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70d190-0e7b-48a4-b5c5-47f41b792f7d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:11.873778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70d190-0e7b-48a4-b5c5-47f41b792f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:11.874049 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70d190-0e7b-48a4-b5c5-47f41b792f7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:11.874754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70d190-0e7b-48a4-b5c5-47f41b792f7d None admin] RBAC: Adding query filter params (role.id=d742575a6b40459fbb329defa3b642c5, scope.project.id=3974bd038bad401ea38236dea8eb3338, user.id=1abe3d8121504673b940ce30beaaaa07) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:11.875062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70d190-0e7b-48a4-b5c5-47f41b792f7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:11.876462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70d190-0e7b-48a4-b5c5-47f41b792f7d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:11.881934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 566/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:21:11 2022] GET /identity/v3/role_assignments?user.id=1abe3d8121504673b940ce30beaaaa07&scope.project.id=3974bd038bad401ea38236dea8eb3338&role.id=d742575a6b40459fbb329defa3b642c5 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:14.012009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bae60-dac7-4695-8035-7c5a20508b28 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:14.012564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bae60-dac7-4695-8035-7c5a20508b28 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:14.012564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bae60-dac7-4695-8035-7c5a20508b28 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:14.013913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 565/1131] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:14.019049 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c657-ec2e-437f-9999-ee87fd17fe34 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:14.019469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c657-ec2e-437f-9999-ee87fd17fe34 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:14.019588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c657-ec2e-437f-9999-ee87fd17fe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:14.037418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ce36c657-ec2e-437f-9999-ee87fd17fe34 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:14.038576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ce36c657-ec2e-437f-9999-ee87fd17fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:14.092289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:14.102598 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 567/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:14.370298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bae60-dac7-4695-8035-7c5a20508b28 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:14.447099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:14.468826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bae60-dac7-4695-8035-7c5a20508b28 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:14.500335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690270db-c1a1-4547-9b93-f8f3dabcd09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:14.500941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690270db-c1a1-4547-9b93-f8f3dabcd09f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:14.501244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690270db-c1a1-4547-9b93-f8f3dabcd09f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:14.501513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690270db-c1a1-4547-9b93-f8f3dabcd09f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:14.502603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690270db-c1a1-4547-9b93-f8f3dabcd09f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:14.504007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690270db-c1a1-4547-9b93-f8f3dabcd09f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:14.505558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 566/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:21:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:14.511730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36c657-ec2e-437f-9999-ee87fd17fe34 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:14.608396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36c657-ec2e-437f-9999-ee87fd17fe34 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:14.641796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd988d5-e1b2-4e15-8a94-f88f63950204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:14.642322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd988d5-e1b2-4e15-8a94-f88f63950204 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:14.642598 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd988d5-e1b2-4e15-8a94-f88f63950204 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:14.642864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd988d5-e1b2-4e15-8a94-f88f63950204 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:14.643509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd988d5-e1b2-4e15-8a94-f88f63950204 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:14.644920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd988d5-e1b2-4e15-8a94-f88f63950204 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:14.670510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 568/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:21:14 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:21:16.828289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7de5ff-8166-4af0-9aae-82da80ebc6cc None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:16.828819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7de5ff-8166-4af0-9aae-82da80ebc6cc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:16.828819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7de5ff-8166-4af0-9aae-82da80ebc6cc None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:16.830186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 567/1135] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:16.835320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322feed-fdce-4817-9ed0-162a7e019b80 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:16.835722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322feed-fdce-4817-9ed0-162a7e019b80 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:16.836423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322feed-fdce-4817-9ed0-162a7e019b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:16.854141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6322feed-fdce-4817-9ed0-162a7e019b80 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:16.855309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6322feed-fdce-4817-9ed0-162a7e019b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:16.893358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:16.920036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 569/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:17.190048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7de5ff-8166-4af0-9aae-82da80ebc6cc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:17.287504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7de5ff-8166-4af0-9aae-82da80ebc6cc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:17.320025 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21d52b-8c08-4e80-ac96-ab8c7fe4fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:17.320668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21d52b-8c08-4e80-ac96-ab8c7fe4fd6a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:17.320965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21d52b-8c08-4e80-ac96-ab8c7fe4fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:17.321251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21d52b-8c08-4e80-ac96-ab8c7fe4fd6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:17.322341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21d52b-8c08-4e80-ac96-ab8c7fe4fd6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:17.323783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21d52b-8c08-4e80-ac96-ab8c7fe4fd6a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:17.325364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 568/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:21:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:17.331168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322feed-fdce-4817-9ed0-162a7e019b80 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:17.426872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322feed-fdce-4817-9ed0-162a7e019b80 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:17.459167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c506f79-4719-41d4-bd78-149bdd982664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:17.459700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c506f79-4719-41d4-bd78-149bdd982664 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:17.459976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c506f79-4719-41d4-bd78-149bdd982664 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:17.460245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c506f79-4719-41d4-bd78-149bdd982664 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:17.460879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c506f79-4719-41d4-bd78-149bdd982664 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:17.462320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c506f79-4719-41d4-bd78-149bdd982664 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:17.482717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 570/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:21:17 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:21:19.641895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76b093-ee48-4bf7-bac9-16b7bcd8a431 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:19.642413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76b093-ee48-4bf7-bac9-16b7bcd8a431 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:19.642413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76b093-ee48-4bf7-bac9-16b7bcd8a431 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:19.643675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 569/1139] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:19.648817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946cbdd-bb05-4524-ba28-710190b0dc4b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:19.649222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946cbdd-bb05-4524-ba28-710190b0dc4b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:19.649394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946cbdd-bb05-4524-ba28-710190b0dc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:19.667646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7946cbdd-bb05-4524-ba28-710190b0dc4b None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:19.668814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7946cbdd-bb05-4524-ba28-710190b0dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:19.691914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:19.734007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 571/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:20.008472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76b093-ee48-4bf7-bac9-16b7bcd8a431 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:20.023674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:20.106642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76b093-ee48-4bf7-bac9-16b7bcd8a431 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:20.138972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d82d65-294a-43f7-8225-8a3c3c15f74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:20.139592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d82d65-294a-43f7-8225-8a3c3c15f74e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:20.139874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d82d65-294a-43f7-8225-8a3c3c15f74e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:20.140149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d82d65-294a-43f7-8225-8a3c3c15f74e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:20.150498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d82d65-294a-43f7-8225-8a3c3c15f74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-20d82d65-294a-43f7-8225-8a3c3c15f74e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:21:20.155592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:21:20.156677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:21:20.157745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 570/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:21:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:21:20.162654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946cbdd-bb05-4524-ba28-710190b0dc4b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:20.257554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946cbdd-bb05-4524-ba28-710190b0dc4b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:20.290947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa31fc8-f0eb-44d1-98b2-94a402c77e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:20.291478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa31fc8-f0eb-44d1-98b2-94a402c77e23 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:20.291757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa31fc8-f0eb-44d1-98b2-94a402c77e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:20.292025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa31fc8-f0eb-44d1-98b2-94a402c77e23 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:20.292677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa31fc8-f0eb-44d1-98b2-94a402c77e23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:20.292999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa31fc8-f0eb-44d1-98b2-94a402c77e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:20.294351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa31fc8-f0eb-44d1-98b2-94a402c77e23 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:20.301982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 572/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:21:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:20.308013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d82d65-294a-43f7-8225-8a3c3c15f74e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:20.381801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:20.407318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d82d65-294a-43f7-8225-8a3c3c15f74e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:20.438385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e379069-ed9f-4c87-a406-b655649da579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:20.439000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e379069-ed9f-4c87-a406-b655649da579 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:20.439281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e379069-ed9f-4c87-a406-b655649da579 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:20.439553 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e379069-ed9f-4c87-a406-b655649da579 None admin] PATH_INFO: `/v3/users/ac08994cf59d4dee818fb30d1806e258` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:20.452463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e379069-ed9f-4c87-a406-b655649da579 None admin] RBAC: Authorizing `identity:get_user(user_id=ac08994cf59d4dee818fb30d1806e258)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:20.453905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e379069-ed9f-4c87-a406-b655649da579 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:20.455477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 571/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:20 2022] GET /identity/v3/users/ac08994cf59d4dee818fb30d1806e258 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:20.461859 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa31fc8-f0eb-44d1-98b2-94a402c77e23 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:20.485760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:20.558978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa31fc8-f0eb-44d1-98b2-94a402c77e23 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:20.591498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f25ae-fb42-4e41-88a5-fd9323375024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:20.592092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f25ae-fb42-4e41-88a5-fd9323375024 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:20.592374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f25ae-fb42-4e41-88a5-fd9323375024 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:20.592644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f25ae-fb42-4e41-88a5-fd9323375024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:20.656883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f25ae-fb42-4e41-88a5-fd9323375024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:20.658341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f25ae-fb42-4e41-88a5-fd9323375024 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:20.680469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:20.752876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 573/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:21:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:21:20.759517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e379069-ed9f-4c87-a406-b655649da579 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:20.853699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e379069-ed9f-4c87-a406-b655649da579 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:20.882053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:20.887603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7028d20-0b80-4e35-98cc-a0baeb5557ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:20.888215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028d20-0b80-4e35-98cc-a0baeb5557ce None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:20.888495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028d20-0b80-4e35-98cc-a0baeb5557ce None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:20.888765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028d20-0b80-4e35-98cc-a0baeb5557ce None admin] PATH_INFO: `/v3/projects/a0f9e2f53040494aa81f43156200e315` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:20.889887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7028d20-0b80-4e35-98cc-a0baeb5557ce None admin] RBAC: Authorizing `identity:get_project(project_id=a0f9e2f53040494aa81f43156200e315)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:20.891291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7028d20-0b80-4e35-98cc-a0baeb5557ce None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:20.892871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 572/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:21:20 2022] GET /identity/v3/projects/a0f9e2f53040494aa81f43156200e315 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:20.898751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f25ae-fb42-4e41-88a5-fd9323375024 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:20.993800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f25ae-fb42-4e41-88a5-fd9323375024 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:21.015271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:21.026636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ded73-90e0-4130-acb8-48a069f62e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:21.027221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ded73-90e0-4130-acb8-48a069f62e3a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:21.027497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ded73-90e0-4130-acb8-48a069f62e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:21.027762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ded73-90e0-4130-acb8-48a069f62e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:21.028732 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ded73-90e0-4130-acb8-48a069f62e3a None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=a0f9e2f53040494aa81f43156200e315, user.id=ac08994cf59d4dee818fb30d1806e258) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:21.029068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ded73-90e0-4130-acb8-48a069f62e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:21.030471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ded73-90e0-4130-acb8-48a069f62e3a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:21.035576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 574/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:21:20 2022] GET /identity/v3/role_assignments?user.id=ac08994cf59d4dee818fb30d1806e258&scope.project.id=a0f9e2f53040494aa81f43156200e315&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:23.132732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbb0c-4655-4d97-b439-c8fab7ab5659 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:23.133277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbb0c-4655-4d97-b439-c8fab7ab5659 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:23.133368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbb0c-4655-4d97-b439-c8fab7ab5659 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:23.134633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 573/1147] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:23.139814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ab3b5-09f5-4fdf-96f7-ac556ce04733 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:23.140251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ab3b5-09f5-4fdf-96f7-ac556ce04733 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:23.140351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ab3b5-09f5-4fdf-96f7-ac556ce04733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:23.158675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b94ab3b5-09f5-4fdf-96f7-ac556ce04733 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:23.159852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b94ab3b5-09f5-4fdf-96f7-ac556ce04733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:23.224449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 575/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 10:21:23.491331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cbb0c-4655-4d97-b439-c8fab7ab5659 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:23.589931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cbb0c-4655-4d97-b439-c8fab7ab5659 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:23.622247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba6d79-9839-4eab-8f36-9d4179a4e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:23.622855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba6d79-9839-4eab-8f36-9d4179a4e60d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:23.623133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba6d79-9839-4eab-8f36-9d4179a4e60d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:23.623402 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba6d79-9839-4eab-8f36-9d4179a4e60d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:23.633489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba6d79-9839-4eab-8f36-9d4179a4e60d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f9ba6d79-9839-4eab-8f36-9d4179a4e60d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:21:23.638211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:21:23.639288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:21:23.640537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 574/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:21:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:21:23.645144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ab3b5-09f5-4fdf-96f7-ac556ce04733 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:23.738613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ab3b5-09f5-4fdf-96f7-ac556ce04733 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:23.754559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:23.772811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3de1ab-8854-4e5c-a46f-53a78361bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:23.773474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3de1ab-8854-4e5c-a46f-53a78361bb28 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:23.773750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3de1ab-8854-4e5c-a46f-53a78361bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:23.774016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3de1ab-8854-4e5c-a46f-53a78361bb28 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:23.774659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3de1ab-8854-4e5c-a46f-53a78361bb28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:23.774958 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3de1ab-8854-4e5c-a46f-53a78361bb28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:23.776300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3de1ab-8854-4e5c-a46f-53a78361bb28 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:23.784273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 576/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:21:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:23.790056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba6d79-9839-4eab-8f36-9d4179a4e60d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:23.847521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:23.887221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba6d79-9839-4eab-8f36-9d4179a4e60d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:23.919365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9581f-8bad-49b8-bb65-8f9733dd6df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:23.919973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9581f-8bad-49b8-bb65-8f9733dd6df0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:23.920257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9581f-8bad-49b8-bb65-8f9733dd6df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:23.920532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9581f-8bad-49b8-bb65-8f9733dd6df0 None admin] PATH_INFO: `/v3/users/ac08994cf59d4dee818fb30d1806e258` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:23.921662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9581f-8bad-49b8-bb65-8f9733dd6df0 None admin] RBAC: Authorizing `identity:get_user(user_id=ac08994cf59d4dee818fb30d1806e258)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:23.923066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9581f-8bad-49b8-bb65-8f9733dd6df0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:23.924605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 575/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:23 2022] GET /identity/v3/users/ac08994cf59d4dee818fb30d1806e258 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:23.930613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3de1ab-8854-4e5c-a46f-53a78361bb28 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:24.026673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3de1ab-8854-4e5c-a46f-53a78361bb28 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:24.059297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95c7b9-f7c8-4218-b02b-38bd69ffd97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:24.059903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95c7b9-f7c8-4218-b02b-38bd69ffd97a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:24.060180 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95c7b9-f7c8-4218-b02b-38bd69ffd97a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:24.060447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95c7b9-f7c8-4218-b02b-38bd69ffd97a None admin] PATH_INFO: `/v3/projects/a0f9e2f53040494aa81f43156200e315` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:24.061541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95c7b9-f7c8-4218-b02b-38bd69ffd97a None admin] RBAC: Authorizing `identity:get_project(project_id=a0f9e2f53040494aa81f43156200e315)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:24.062935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95c7b9-f7c8-4218-b02b-38bd69ffd97a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:24.064501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 577/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:21:23 2022] GET /identity/v3/projects/a0f9e2f53040494aa81f43156200e315 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:24.070313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9581f-8bad-49b8-bb65-8f9733dd6df0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:24.166360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9581f-8bad-49b8-bb65-8f9733dd6df0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:24.191411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:24.200342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9d28f-cb1c-4a86-9cba-2653ed442251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:24.201036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d28f-cb1c-4a86-9cba-2653ed442251 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:24.201323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d28f-cb1c-4a86-9cba-2653ed442251 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:24.201600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d28f-cb1c-4a86-9cba-2653ed442251 None admin] PATH_INFO: `/v3/projects/a0f9e2f53040494aa81f43156200e315/users/ac08994cf59d4dee818fb30d1806e258/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:24.204435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9d28f-cb1c-4a86-9cba-2653ed442251 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0f9e2f53040494aa81f43156200e315, user_id=ac08994cf59d4dee818fb30d1806e258, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:24.205902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9d28f-cb1c-4a86-9cba-2653ed442251 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:24.221006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 576/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:21:24 2022] PUT /identity/v3/projects/a0f9e2f53040494aa81f43156200e315/users/ac08994cf59d4dee818fb30d1806e258/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:21:26.364530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59626fe4-f438-469a-8389-7ea5a4b8621e None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:26.365103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59626fe4-f438-469a-8389-7ea5a4b8621e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:26.365103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59626fe4-f438-469a-8389-7ea5a4b8621e None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:26.366444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 578/1154] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:26.371751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e09cb-1af5-43b6-a2e7-eea7793374ee None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:26.372204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e09cb-1af5-43b6-a2e7-eea7793374ee None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:26.372308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e09cb-1af5-43b6-a2e7-eea7793374ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:26.390613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d13e09cb-1af5-43b6-a2e7-eea7793374ee None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:26.391786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d13e09cb-1af5-43b6-a2e7-eea7793374ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:26.455529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 577/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:26.723616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59626fe4-f438-469a-8389-7ea5a4b8621e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:26.769619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:26.823875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59626fe4-f438-469a-8389-7ea5a4b8621e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:26.856792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc58b4-47d3-4bdd-91b4-5a031f40a2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:26.857432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc58b4-47d3-4bdd-91b4-5a031f40a2eb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:26.857708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc58b4-47d3-4bdd-91b4-5a031f40a2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:26.857976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc58b4-47d3-4bdd-91b4-5a031f40a2eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:26.868055 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc58b4-47d3-4bdd-91b4-5a031f40a2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-6ccc58b4-47d3-4bdd-91b4-5a031f40a2eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:21:26.872763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:21:26.873967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:21:26.874873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 579/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:21:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:21:26.879861 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e09cb-1af5-43b6-a2e7-eea7793374ee None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:26.974773 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e09cb-1af5-43b6-a2e7-eea7793374ee None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:26.990849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:27.009238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ebcb-d47d-49bc-a01e-d7b605270b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:27.009832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ebcb-d47d-49bc-a01e-d7b605270b3c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:27.010112 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ebcb-d47d-49bc-a01e-d7b605270b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:27.010382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ebcb-d47d-49bc-a01e-d7b605270b3c None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:27.011037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ebcb-d47d-49bc-a01e-d7b605270b3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:27.011340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ebcb-d47d-49bc-a01e-d7b605270b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:27.012675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ebcb-d47d-49bc-a01e-d7b605270b3c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:27.020369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 578/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:21:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:27.026788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc58b4-47d3-4bdd-91b4-5a031f40a2eb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:27.122546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc58b4-47d3-4bdd-91b4-5a031f40a2eb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:27.129001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:27.156417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9427a4-08c1-4a81-9738-28989ff680d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:27.157075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9427a4-08c1-4a81-9738-28989ff680d2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:27.157358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9427a4-08c1-4a81-9738-28989ff680d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:27.157632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9427a4-08c1-4a81-9738-28989ff680d2 None admin] PATH_INFO: `/v3/users/ac08994cf59d4dee818fb30d1806e258` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:27.158739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9427a4-08c1-4a81-9738-28989ff680d2 None admin] RBAC: Authorizing `identity:get_user(user_id=ac08994cf59d4dee818fb30d1806e258)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:27.160160 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9427a4-08c1-4a81-9738-28989ff680d2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:27.161740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 580/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:27 2022] GET /identity/v3/users/ac08994cf59d4dee818fb30d1806e258 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:27.167480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ebcb-d47d-49bc-a01e-d7b605270b3c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:27.263324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ebcb-d47d-49bc-a01e-d7b605270b3c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:27.295739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96cb3e-5aaf-4750-adeb-4bb1840e0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:27.296322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96cb3e-5aaf-4750-adeb-4bb1840e0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:27.296601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96cb3e-5aaf-4750-adeb-4bb1840e0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:27.296869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96cb3e-5aaf-4750-adeb-4bb1840e0ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:27.342518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:27.362328 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96cb3e-5aaf-4750-adeb-4bb1840e0ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:27.363777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96cb3e-5aaf-4750-adeb-4bb1840e0ce0 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:27.457808 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 579/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:21:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:21:27.463624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9427a4-08c1-4a81-9738-28989ff680d2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:27.560115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9427a4-08c1-4a81-9738-28989ff680d2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:27.592564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf09ea-ae7a-4d10-a188-66d6ed508cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:27.593204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf09ea-ae7a-4d10-a188-66d6ed508cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:27.593484 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf09ea-ae7a-4d10-a188-66d6ed508cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:27.593754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf09ea-ae7a-4d10-a188-66d6ed508cf1 None admin] PATH_INFO: `/v3/projects/a0f9e2f53040494aa81f43156200e315` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:27.594848 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf09ea-ae7a-4d10-a188-66d6ed508cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=a0f9e2f53040494aa81f43156200e315)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:27.596268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf09ea-ae7a-4d10-a188-66d6ed508cf1 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:27.597876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 581/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:21:27 2022] GET /identity/v3/projects/a0f9e2f53040494aa81f43156200e315 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:27.603684 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96cb3e-5aaf-4750-adeb-4bb1840e0ce0 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:27.679374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:27.699207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96cb3e-5aaf-4750-adeb-4bb1840e0ce0 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:27.731601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44804b4-a04d-4532-a219-08b3fb11cd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:27.732187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44804b4-a04d-4532-a219-08b3fb11cd52 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:27.732470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44804b4-a04d-4532-a219-08b3fb11cd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:27.732746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44804b4-a04d-4532-a219-08b3fb11cd52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:27.733490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44804b4-a04d-4532-a219-08b3fb11cd52 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=a0f9e2f53040494aa81f43156200e315, user.id=ac08994cf59d4dee818fb30d1806e258) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:27.733804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44804b4-a04d-4532-a219-08b3fb11cd52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:27.735201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44804b4-a04d-4532-a219-08b3fb11cd52 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:27.740745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 580/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:21:27 2022] GET /identity/v3/role_assignments?user.id=ac08994cf59d4dee818fb30d1806e258&scope.project.id=a0f9e2f53040494aa81f43156200e315&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:29.894733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b2a5-9ce1-4382-ad99-0470ce321398 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:29.895241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b2a5-9ce1-4382-ad99-0470ce321398 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:29.895350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b2a5-9ce1-4382-ad99-0470ce321398 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:29.896599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 582/1162] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:29.902240 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e255ee-5e91-471a-8b67-067156fefdc3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:29.902623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e255ee-5e91-471a-8b67-067156fefdc3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:29.902786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e255ee-5e91-471a-8b67-067156fefdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:29.921311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-74e255ee-5e91-471a-8b67-067156fefdc3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:29.922488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-74e255ee-5e91-471a-8b67-067156fefdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:29.986152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 581/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:30.253602 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b2a5-9ce1-4382-ad99-0470ce321398 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:30.297314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:30.352802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b2a5-9ce1-4382-ad99-0470ce321398 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:30.386678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7d144-61d7-46a6-8470-a223ec71711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:30.387274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7d144-61d7-46a6-8470-a223ec71711d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:30.387555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7d144-61d7-46a6-8470-a223ec71711d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:30.387826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7d144-61d7-46a6-8470-a223ec71711d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:30.452355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7d144-61d7-46a6-8470-a223ec71711d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:30.453818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7d144-61d7-46a6-8470-a223ec71711d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:30.492801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:30.547279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 583/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:21:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:21:30.553117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e255ee-5e91-471a-8b67-067156fefdc3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:30.623036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:30.647269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e255ee-5e91-471a-8b67-067156fefdc3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:30.678960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36806ef7-1a58-49b4-bfab-193c8d8e1dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:30.680067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36806ef7-1a58-49b4-bfab-193c8d8e1dfd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:30.680360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36806ef7-1a58-49b4-bfab-193c8d8e1dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:30.680629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36806ef7-1a58-49b4-bfab-193c8d8e1dfd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:30.687248 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36806ef7-1a58-49b4-bfab-193c8d8e1dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:30.688669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36806ef7-1a58-49b4-bfab-193c8d8e1dfd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-36806ef7-1a58-49b4-bfab-193c8d8e1dfd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:21:30.700878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:21:30.702137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:21:30.703287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 582/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 10:21:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:21:30.707816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7d144-61d7-46a6-8470-a223ec71711d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:30.802922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7d144-61d7-46a6-8470-a223ec71711d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:30.835713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6431eb-94c7-4141-aa05-904052fbb554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:30.836327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6431eb-94c7-4141-aa05-904052fbb554 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:30.836605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6431eb-94c7-4141-aa05-904052fbb554 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:30.836873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6431eb-94c7-4141-aa05-904052fbb554 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:30.837530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6431eb-94c7-4141-aa05-904052fbb554 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:30.837833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6431eb-94c7-4141-aa05-904052fbb554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:30.839171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6431eb-94c7-4141-aa05-904052fbb554 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:30.846024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 584/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 10:21:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:32.946994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fadd-bcc0-47a9-92d0-68f94c26ca90 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:32.947549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fadd-bcc0-47a9-92d0-68f94c26ca90 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:32.947549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fadd-bcc0-47a9-92d0-68f94c26ca90 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:32.948864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 583/1167] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:32.954036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b495969-68d6-44ba-8269-2ec73d57313d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:32.954406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b495969-68d6-44ba-8269-2ec73d57313d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:32.954584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b495969-68d6-44ba-8269-2ec73d57313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:32.967732 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:32.973398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1b495969-68d6-44ba-8269-2ec73d57313d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:32.974570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1b495969-68d6-44ba-8269-2ec73d57313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:33.039899 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 585/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:33.305176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0fadd-bcc0-47a9-92d0-68f94c26ca90 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:33.402415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0fadd-bcc0-47a9-92d0-68f94c26ca90 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:33.434492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca00f01-7c7c-4abe-8d65-5c1df93d4788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:33.435072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca00f01-7c7c-4abe-8d65-5c1df93d4788 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:33.435349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca00f01-7c7c-4abe-8d65-5c1df93d4788 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:33.435619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca00f01-7c7c-4abe-8d65-5c1df93d4788 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:33.436267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca00f01-7c7c-4abe-8d65-5c1df93d4788 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:33.437618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca00f01-7c7c-4abe-8d65-5c1df93d4788 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:33.441286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:33.453579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 584/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Mon Sep 26 10:21:33 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:21:35.594929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f8ffc-6186-43c8-a633-f5058bc35906 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:35.595478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f8ffc-6186-43c8-a633-f5058bc35906 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:35.595478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f8ffc-6186-43c8-a633-f5058bc35906 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:35.596807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 586/1170] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:35.602663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee531a-2d69-416f-950f-b0b377a32249 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:35.603098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee531a-2d69-416f-950f-b0b377a32249 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:35.603198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee531a-2d69-416f-950f-b0b377a32249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:35.620869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0fee531a-2d69-416f-950f-b0b377a32249 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:35.622022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0fee531a-2d69-416f-950f-b0b377a32249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:35.688966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 585/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:35.959119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f8ffc-6186-43c8-a633-f5058bc35906 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:36.059381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f8ffc-6186-43c8-a633-f5058bc35906 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:36.093520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470874a1-b96c-430d-96d4-46510c9c9964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:36.094139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470874a1-b96c-430d-96d4-46510c9c9964 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:36.094420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470874a1-b96c-430d-96d4-46510c9c9964 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:36.094696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470874a1-b96c-430d-96d4-46510c9c9964 None admin] PATH_INFO: `/v3/domains/18b382b2eae14e478343da19030a8192` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:36.097308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:36.105543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470874a1-b96c-430d-96d4-46510c9c9964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=18b382b2eae14e478343da19030a8192)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:36.106970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470874a1-b96c-430d-96d4-46510c9c9964 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:36.108528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 587/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Sep 26 10:21:35 2022] GET /identity/v3/domains/18b382b2eae14e478343da19030a8192 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:36.114320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee531a-2d69-416f-950f-b0b377a32249 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:36.210567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee531a-2d69-416f-950f-b0b377a32249 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:36.233435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:36.244702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd51ea-72e4-4c7f-8d28-b344c4652dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:36.245340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd51ea-72e4-4c7f-8d28-b344c4652dcc None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:36.245624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd51ea-72e4-4c7f-8d28-b344c4652dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:36.245899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd51ea-72e4-4c7f-8d28-b344c4652dcc None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:36.246549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd51ea-72e4-4c7f-8d28-b344c4652dcc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:36.247962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd51ea-72e4-4c7f-8d28-b344c4652dcc None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:36.273015 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 586/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:21:36 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:21:38.448823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f1eb-327a-4d27-8ad6-9cab0dff9479 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:38.449340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f1eb-327a-4d27-8ad6-9cab0dff9479 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:38.449431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f1eb-327a-4d27-8ad6-9cab0dff9479 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:38.450722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 588/1174] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:38.455848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db3a4d-9008-41f1-9304-8db222175dbb None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:38.456219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db3a4d-9008-41f1-9304-8db222175dbb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:38.456409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db3a4d-9008-41f1-9304-8db222175dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:38.474207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e0db3a4d-9008-41f1-9304-8db222175dbb None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:38.475395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e0db3a4d-9008-41f1-9304-8db222175dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:38.539997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 587/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:38.808042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f1eb-327a-4d27-8ad6-9cab0dff9479 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:38.906923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f1eb-327a-4d27-8ad6-9cab0dff9479 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:38.939191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a057350-790a-4348-96a0-a4e4a62c16a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:38.939797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a057350-790a-4348-96a0-a4e4a62c16a8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:38.940072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a057350-790a-4348-96a0-a4e4a62c16a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:38.940345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a057350-790a-4348-96a0-a4e4a62c16a8 None admin] PATH_INFO: `/v3/domains/18b382b2eae14e478343da19030a8192` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:38.941460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a057350-790a-4348-96a0-a4e4a62c16a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=18b382b2eae14e478343da19030a8192)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:38.942863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a057350-790a-4348-96a0-a4e4a62c16a8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:38.944383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 589/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Sep 26 10:21:38 2022] GET /identity/v3/domains/18b382b2eae14e478343da19030a8192 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:38.950469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db3a4d-9008-41f1-9304-8db222175dbb None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:39.046609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db3a4d-9008-41f1-9304-8db222175dbb None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:39.053599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:39.080647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996e89c-3fb0-4d45-a228-59eb8d6c7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:39.081264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996e89c-3fb0-4d45-a228-59eb8d6c7aaa None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:39.081549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996e89c-3fb0-4d45-a228-59eb8d6c7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:39.081823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996e89c-3fb0-4d45-a228-59eb8d6c7aaa None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:39.082472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996e89c-3fb0-4d45-a228-59eb8d6c7aaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:39.083886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996e89c-3fb0-4d45-a228-59eb8d6c7aaa None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:39.105495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 588/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:21:38 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:21:41.280116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea471c8-6a55-48a3-a296-7654d3400f82 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:41.280675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea471c8-6a55-48a3-a296-7654d3400f82 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:41.280675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea471c8-6a55-48a3-a296-7654d3400f82 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:41.282004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 590/1178] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:41.287277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36ab1f-94ab-4ab7-bfcb-9732c826e84b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:41.287695 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36ab1f-94ab-4ab7-bfcb-9732c826e84b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:41.287832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36ab1f-94ab-4ab7-bfcb-9732c826e84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:41.306559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-fc36ab1f-94ab-4ab7-bfcb-9732c826e84b None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:41.307727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fc36ab1f-94ab-4ab7-bfcb-9732c826e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:41.371919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 589/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:41.642575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea471c8-6a55-48a3-a296-7654d3400f82 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:41.703486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:41.741301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea471c8-6a55-48a3-a296-7654d3400f82 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:41.772480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2750a13-c367-46e3-9d54-1e04995e61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:41.773112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750a13-c367-46e3-9d54-1e04995e61b9 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:41.773895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750a13-c367-46e3-9d54-1e04995e61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:41.774169 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750a13-c367-46e3-9d54-1e04995e61b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:41.784373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2750a13-c367-46e3-9d54-1e04995e61b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-b2750a13-c367-46e3-9d54-1e04995e61b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:21:41.789700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:21:41.790595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:21:41.791459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 591/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:21:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:21:41.796773 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36ab1f-94ab-4ab7-bfcb-9732c826e84b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:41.884781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:41.893786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36ab1f-94ab-4ab7-bfcb-9732c826e84b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:41.926703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d289b4a-3d80-46b9-a7f2-32a4489d8784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:41.927295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d289b4a-3d80-46b9-a7f2-32a4489d8784 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:41.927571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d289b4a-3d80-46b9-a7f2-32a4489d8784 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:41.927835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d289b4a-3d80-46b9-a7f2-32a4489d8784 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:41.928487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d289b4a-3d80-46b9-a7f2-32a4489d8784 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:41.928785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d289b4a-3d80-46b9-a7f2-32a4489d8784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:41.930190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d289b4a-3d80-46b9-a7f2-32a4489d8784 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:41.937786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 590/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:21:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:41.943639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2750a13-c367-46e3-9d54-1e04995e61b9 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:42.040277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2750a13-c367-46e3-9d54-1e04995e61b9 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:42.061825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:42.072730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6bcf7-5668-4fa4-b01f-5fa7e4c69335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:42.073383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6bcf7-5668-4fa4-b01f-5fa7e4c69335 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:42.073664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6bcf7-5668-4fa4-b01f-5fa7e4c69335 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:42.073935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6bcf7-5668-4fa4-b01f-5fa7e4c69335 None admin] PATH_INFO: `/v3/users/1496b4ea42af4c3398cfdfda766c5ef1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:42.086920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6bcf7-5668-4fa4-b01f-5fa7e4c69335 None admin] RBAC: Authorizing `identity:get_user(user_id=1496b4ea42af4c3398cfdfda766c5ef1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:42.088321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6bcf7-5668-4fa4-b01f-5fa7e4c69335 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:42.089894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 592/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:41 2022] GET /identity/v3/users/1496b4ea42af4c3398cfdfda766c5ef1 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:42.095627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d289b4a-3d80-46b9-a7f2-32a4489d8784 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:42.191300 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d289b4a-3d80-46b9-a7f2-32a4489d8784 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:42.223889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ce1c5-a65b-49e2-b8a5-2ce3624c9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:42.224472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ce1c5-a65b-49e2-b8a5-2ce3624c9a2e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:42.224752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ce1c5-a65b-49e2-b8a5-2ce3624c9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:42.225050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ce1c5-a65b-49e2-b8a5-2ce3624c9a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:42.247240 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:42.289615 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ce1c5-a65b-49e2-b8a5-2ce3624c9a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:42.291059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ce1c5-a65b-49e2-b8a5-2ce3624c9a2e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:42.385017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 591/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:21:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:21:42.390867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6bcf7-5668-4fa4-b01f-5fa7e4c69335 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:42.488894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6bcf7-5668-4fa4-b01f-5fa7e4c69335 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:42.522039 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f475ef-ef8f-4147-bf12-eaeda1e94c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:42.522656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f475ef-ef8f-4147-bf12-eaeda1e94c15 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:42.522933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f475ef-ef8f-4147-bf12-eaeda1e94c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:42.523201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f475ef-ef8f-4147-bf12-eaeda1e94c15 None admin] PATH_INFO: `/v3/projects/f3428f84fb264103a2a19dc0851d51ac` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:42.524294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f475ef-ef8f-4147-bf12-eaeda1e94c15 None admin] RBAC: Authorizing `identity:get_project(project_id=f3428f84fb264103a2a19dc0851d51ac)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:42.525732 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f475ef-ef8f-4147-bf12-eaeda1e94c15 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:42.527327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 593/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:21:42 2022] GET /identity/v3/projects/f3428f84fb264103a2a19dc0851d51ac => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:42.533680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ce1c5-a65b-49e2-b8a5-2ce3624c9a2e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:42.585670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:42.627916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ce1c5-a65b-49e2-b8a5-2ce3624c9a2e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:42.660072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7a95d-d39b-49f6-a937-399f9064142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:42.660655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7a95d-d39b-49f6-a937-399f9064142e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:42.660933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7a95d-d39b-49f6-a937-399f9064142e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:42.661234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7a95d-d39b-49f6-a937-399f9064142e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:42.661939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7a95d-d39b-49f6-a937-399f9064142e None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=f3428f84fb264103a2a19dc0851d51ac, user.id=1496b4ea42af4c3398cfdfda766c5ef1) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:42.662244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7a95d-d39b-49f6-a937-399f9064142e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:42.663626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7a95d-d39b-49f6-a937-399f9064142e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:42.668729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 592/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:21:42 2022] GET /identity/v3/role_assignments?user.id=1496b4ea42af4c3398cfdfda766c5ef1&scope.project.id=f3428f84fb264103a2a19dc0851d51ac&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:44.772135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43901b6-df1b-4633-9066-f896c8142340 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:44.772632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43901b6-df1b-4633-9066-f896c8142340 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:44.772632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43901b6-df1b-4633-9066-f896c8142340 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:44.774483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 594/1186] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:44.779833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af7816-a83b-4b27-8c9c-d52370c2f8c1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:44.780264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af7816-a83b-4b27-8c9c-d52370c2f8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:44.780371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af7816-a83b-4b27-8c9c-d52370c2f8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:44.798504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-25af7816-a83b-4b27-8c9c-d52370c2f8c1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:44.799665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-25af7816-a83b-4b27-8c9c-d52370c2f8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:44.862427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 593/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:45.129775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43901b6-df1b-4633-9066-f896c8142340 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:45.180608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:45.229354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43901b6-df1b-4633-9066-f896c8142340 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:45.261387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b03dde-8b89-44d8-8f0f-8f0f8eeeca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:45.261996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03dde-8b89-44d8-8f0f-8f0f8eeeca6e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:45.262275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03dde-8b89-44d8-8f0f-8f0f8eeeca6e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:45.262543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b03dde-8b89-44d8-8f0f-8f0f8eeeca6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:45.272108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b03dde-8b89-44d8-8f0f-8f0f8eeeca6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-02b03dde-8b89-44d8-8f0f-8f0f8eeeca6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:21:45.277501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:21:45.278606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:21:45.280005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 595/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:21:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:21:45.284804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af7816-a83b-4b27-8c9c-d52370c2f8c1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:45.331735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:45.381438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af7816-a83b-4b27-8c9c-d52370c2f8c1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:45.413646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba569-e916-43ed-b477-72e6f07d43e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:45.414235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba569-e916-43ed-b477-72e6f07d43e9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:45.414510 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba569-e916-43ed-b477-72e6f07d43e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:45.414777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba569-e916-43ed-b477-72e6f07d43e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:45.415420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba569-e916-43ed-b477-72e6f07d43e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:45.415716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba569-e916-43ed-b477-72e6f07d43e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:45.417067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba569-e916-43ed-b477-72e6f07d43e9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:45.424602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 594/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:21:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:45.430971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b03dde-8b89-44d8-8f0f-8f0f8eeeca6e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:45.527271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b03dde-8b89-44d8-8f0f-8f0f8eeeca6e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:45.537884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:45.561257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781cb80-f256-4e59-a66b-109818a9264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:45.561870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781cb80-f256-4e59-a66b-109818a9264a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:45.562147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781cb80-f256-4e59-a66b-109818a9264a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:45.562416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781cb80-f256-4e59-a66b-109818a9264a None admin] PATH_INFO: `/v3/users/1496b4ea42af4c3398cfdfda766c5ef1` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:45.563524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781cb80-f256-4e59-a66b-109818a9264a None admin] RBAC: Authorizing `identity:get_user(user_id=1496b4ea42af4c3398cfdfda766c5ef1)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:45.564942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781cb80-f256-4e59-a66b-109818a9264a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:45.566511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 596/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:45 2022] GET /identity/v3/users/1496b4ea42af4c3398cfdfda766c5ef1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:45.573185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba569-e916-43ed-b477-72e6f07d43e9 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:45.668141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba569-e916-43ed-b477-72e6f07d43e9 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:45.677790 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:45.701526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ac1d7-c5dc-4cdb-a84c-ad15d70be04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:45.702144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac1d7-c5dc-4cdb-a84c-ad15d70be04b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:45.702426 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac1d7-c5dc-4cdb-a84c-ad15d70be04b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:45.702700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac1d7-c5dc-4cdb-a84c-ad15d70be04b None admin] PATH_INFO: `/v3/projects/f3428f84fb264103a2a19dc0851d51ac` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:45.703799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ac1d7-c5dc-4cdb-a84c-ad15d70be04b None admin] RBAC: Authorizing `identity:get_project(project_id=f3428f84fb264103a2a19dc0851d51ac)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:45.705232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ac1d7-c5dc-4cdb-a84c-ad15d70be04b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:45.706824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 595/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:21:45 2022] GET /identity/v3/projects/f3428f84fb264103a2a19dc0851d51ac => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:45.712576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781cb80-f256-4e59-a66b-109818a9264a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:45.809227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781cb80-f256-4e59-a66b-109818a9264a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:45.841463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279857fd-4dd8-49ac-b38a-ae11e7470b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:45.842102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279857fd-4dd8-49ac-b38a-ae11e7470b58 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:45.842386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279857fd-4dd8-49ac-b38a-ae11e7470b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:45.842661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279857fd-4dd8-49ac-b38a-ae11e7470b58 None admin] PATH_INFO: `/v3/projects/f3428f84fb264103a2a19dc0851d51ac/users/1496b4ea42af4c3398cfdfda766c5ef1/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:45.844545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279857fd-4dd8-49ac-b38a-ae11e7470b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3428f84fb264103a2a19dc0851d51ac, user_id=1496b4ea42af4c3398cfdfda766c5ef1, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:45.845983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279857fd-4dd8-49ac-b38a-ae11e7470b58 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:45.858366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 597/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:21:45 2022] PUT /identity/v3/projects/f3428f84fb264103a2a19dc0851d51ac/users/1496b4ea42af4c3398cfdfda766c5ef1/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:21:47.961975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f966ec-398b-4e01-b12f-f7d77c9e5cb7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:47.962503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f966ec-398b-4e01-b12f-f7d77c9e5cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:47.962503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f966ec-398b-4e01-b12f-f7d77c9e5cb7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:47.963831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 596/1193] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:21:47.969200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ddad-c958-4b54-a757-98263ed51c31 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:47.969574 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ddad-c958-4b54-a757-98263ed51c31 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:47.969742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5ddad-c958-4b54-a757-98263ed51c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:47.987187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-baa5ddad-c958-4b54-a757-98263ed51c31 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:21:47.988389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-baa5ddad-c958-4b54-a757-98263ed51c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:21:48.017593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:48.054874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 598/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:21:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:21:48.328272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f966ec-398b-4e01-b12f-f7d77c9e5cb7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:48.428579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f966ec-398b-4e01-b12f-f7d77c9e5cb7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:48.460953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9cf4a-3606-46dd-8d06-fa14aff73b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:48.461593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9cf4a-3606-46dd-8d06-fa14aff73b4b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:48.461869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9cf4a-3606-46dd-8d06-fa14aff73b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:48.462138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9cf4a-3606-46dd-8d06-fa14aff73b4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:48.471642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9cf4a-3606-46dd-8d06-fa14aff73b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-44f9cf4a-3606-46dd-8d06-fa14aff73b4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:21:48.476363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:21:48.477504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:21:48.478578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 597/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:21:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:21:48.483658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5ddad-c958-4b54-a757-98263ed51c31 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:48.579510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5ddad-c958-4b54-a757-98263ed51c31 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:48.613277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae27e0-6199-4267-bfc1-68e9792938c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:48.613883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae27e0-6199-4267-bfc1-68e9792938c2 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:48.614163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae27e0-6199-4267-bfc1-68e9792938c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:48.614437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae27e0-6199-4267-bfc1-68e9792938c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:48.615097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae27e0-6199-4267-bfc1-68e9792938c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:48.615399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae27e0-6199-4267-bfc1-68e9792938c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:48.616755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae27e0-6199-4267-bfc1-68e9792938c2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:48.625397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 599/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:21:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:48.631459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9cf4a-3606-46dd-8d06-fa14aff73b4b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:48.670811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:48.728238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9cf4a-3606-46dd-8d06-fa14aff73b4b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:48.760753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e4596-8327-4564-8263-691ff899afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:48.761382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e4596-8327-4564-8263-691ff899afb6 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:48.761661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e4596-8327-4564-8263-691ff899afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:48.761928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e4596-8327-4564-8263-691ff899afb6 None admin] PATH_INFO: `/v3/users/1496b4ea42af4c3398cfdfda766c5ef1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:48.763019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e4596-8327-4564-8263-691ff899afb6 None admin] RBAC: Authorizing `identity:get_user(user_id=1496b4ea42af4c3398cfdfda766c5ef1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:48.764420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e4596-8327-4564-8263-691ff899afb6 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:48.765979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 598/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 10:21:48 2022] GET /identity/v3/users/1496b4ea42af4c3398cfdfda766c5ef1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:48.771861 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae27e0-6199-4267-bfc1-68e9792938c2 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:48.802314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:48.870537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae27e0-6199-4267-bfc1-68e9792938c2 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:48.903607 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609eb55-34ad-4a05-8be7-34ec5b30e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:48.904212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609eb55-34ad-4a05-8be7-34ec5b30e6ab None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:48.904754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609eb55-34ad-4a05-8be7-34ec5b30e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:48.905229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609eb55-34ad-4a05-8be7-34ec5b30e6ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:48.974565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609eb55-34ad-4a05-8be7-34ec5b30e6ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:48.976010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609eb55-34ad-4a05-8be7-34ec5b30e6ab None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:49.003516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:49.071606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 600/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:21:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:21:49.077548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e4596-8327-4564-8263-691ff899afb6 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:49.173692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e4596-8327-4564-8263-691ff899afb6 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:49.180212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:49.207130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596f0f0-510a-4d15-8d4e-7b6cd1878862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:49.207747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f0f0-510a-4d15-8d4e-7b6cd1878862 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:49.208028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f0f0-510a-4d15-8d4e-7b6cd1878862 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:49.208304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f0f0-510a-4d15-8d4e-7b6cd1878862 None admin] PATH_INFO: `/v3/projects/f3428f84fb264103a2a19dc0851d51ac` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:49.209434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596f0f0-510a-4d15-8d4e-7b6cd1878862 None admin] RBAC: Authorizing `identity:get_project(project_id=f3428f84fb264103a2a19dc0851d51ac)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:49.210850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596f0f0-510a-4d15-8d4e-7b6cd1878862 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:49.212982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 599/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 10:21:49 2022] GET /identity/v3/projects/f3428f84fb264103a2a19dc0851d51ac => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:49.218947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609eb55-34ad-4a05-8be7-34ec5b30e6ab None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:21:49.323248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609eb55-34ad-4a05-8be7-34ec5b30e6ab None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:21:49.351107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:49.358500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306ccaa-a538-4d63-bb81-1abfc7de26ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:21:49.359105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ccaa-a538-4d63-bb81-1abfc7de26ce None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:21:49.359384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ccaa-a538-4d63-bb81-1abfc7de26ce None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:21:49.359655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ccaa-a538-4d63-bb81-1abfc7de26ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:21:49.360374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306ccaa-a538-4d63-bb81-1abfc7de26ce None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=f3428f84fb264103a2a19dc0851d51ac, user.id=1496b4ea42af4c3398cfdfda766c5ef1) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:21:49.360688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306ccaa-a538-4d63-bb81-1abfc7de26ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:21:49.362148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306ccaa-a538-4d63-bb81-1abfc7de26ce None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:21:49.367966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 601/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:21:49 2022] GET /identity/v3/role_assignments?user.id=1496b4ea42af4c3398cfdfda766c5ef1&scope.project.id=f3428f84fb264103a2a19dc0851d51ac&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:21:59.203042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=13 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:21:59.365796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:44.769834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9768c-9844-4fdb-a8c2-6ec47227fa92 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:44.770393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9768c-9844-4fdb-a8c2-6ec47227fa92 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:44.770393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9768c-9844-4fdb-a8c2-6ec47227fa92 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:44.772180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 600/1201] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:22:44.778312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f38c7-1796-4fd8-9495-6cadfd778337 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:44.779300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f38c7-1796-4fd8-9495-6cadfd778337 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:44.779783 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f38c7-1796-4fd8-9495-6cadfd778337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:44.802391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-af8f38c7-1796-4fd8-9495-6cadfd778337 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:22:44.804176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-af8f38c7-1796-4fd8-9495-6cadfd778337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:22:44.897643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 602/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:22:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:22:45.171301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9768c-9844-4fdb-a8c2-6ec47227fa92 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:45.303177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9768c-9844-4fdb-a8c2-6ec47227fa92 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:45.346271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224024ef-0a46-4758-941e-4d285ec5f8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:45.347025 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224024ef-0a46-4758-941e-4d285ec5f8ac None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:45.347315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224024ef-0a46-4758-941e-4d285ec5f8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:45.347655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224024ef-0a46-4758-941e-4d285ec5f8ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:45.373263 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224024ef-0a46-4758-941e-4d285ec5f8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:45.375163 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224024ef-0a46-4758-941e-4d285ec5f8ac None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-224024ef-0a46-4758-941e-4d285ec5f8ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:22:45.395419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:45.396689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:22:45.403086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:22:45.403086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:45.403086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:22:45.403086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 601/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:45.403337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f38c7-1796-4fd8-9495-6cadfd778337 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:45.523228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f38c7-1796-4fd8-9495-6cadfd778337 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:45.563362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:45.571269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ac830-8929-445e-819a-3643773ab0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:45.571898 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac830-8929-445e-819a-3643773ab0de None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:45.572180 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac830-8929-445e-819a-3643773ab0de None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:45.572455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac830-8929-445e-819a-3643773ab0de None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:45.573294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ac830-8929-445e-819a-3643773ab0de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:45.573573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ac830-8929-445e-819a-3643773ab0de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:45.574918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ac830-8929-445e-819a-3643773ab0de None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:45.592482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 603/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:22:45.593464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224024ef-0a46-4758-941e-4d285ec5f8ac None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:45.650982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:45.714673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224024ef-0a46-4758-941e-4d285ec5f8ac None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:45.764006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c7067-aa13-42c0-a880-831bc3dd1e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:45.764627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c7067-aa13-42c0-a880-831bc3dd1e01 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:45.765300 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c7067-aa13-42c0-a880-831bc3dd1e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:45.766241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c7067-aa13-42c0-a880-831bc3dd1e01 None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:45.767028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c7067-aa13-42c0-a880-831bc3dd1e01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:45.768716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c7067-aa13-42c0-a880-831bc3dd1e01 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:45.798304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 602/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 10:22:45 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:22:48.126423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0289f-1c33-42c4-a018-1f7da5545abc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:48.127005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0289f-1c33-42c4-a018-1f7da5545abc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:48.127005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0289f-1c33-42c4-a018-1f7da5545abc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:48.128295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 604/1206] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:22:48.133869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779cf1f-49bf-438f-8b6d-48aca91a93a9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:48.134321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779cf1f-49bf-438f-8b6d-48aca91a93a9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:48.134426 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779cf1f-49bf-438f-8b6d-48aca91a93a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:48.153871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f779cf1f-49bf-438f-8b6d-48aca91a93a9 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:22:48.155228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f779cf1f-49bf-438f-8b6d-48aca91a93a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:22:48.240738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 603/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:22:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:22:48.512029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0289f-1c33-42c4-a018-1f7da5545abc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:48.627955 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0289f-1c33-42c4-a018-1f7da5545abc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:48.670611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30d9dd-ab24-4a95-b3ec-6e30348b65a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:48.671320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30d9dd-ab24-4a95-b3ec-6e30348b65a0 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:48.671765 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30d9dd-ab24-4a95-b3ec-6e30348b65a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:48.672051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30d9dd-ab24-4a95-b3ec-6e30348b65a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:48.685706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30d9dd-ab24-4a95-b3ec-6e30348b65a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-ec30d9dd-ab24-4a95-b3ec-6e30348b65a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:22:48.691938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:48.692922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:22:48.693785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 605/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:22:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:48.700848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779cf1f-49bf-438f-8b6d-48aca91a93a9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:48.741882 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:48.815518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779cf1f-49bf-438f-8b6d-48aca91a93a9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:48.853268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6567c-9dd5-4bc5-b876-911d555f086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:48.853873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6567c-9dd5-4bc5-b876-911d555f086c None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:48.854167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6567c-9dd5-4bc5-b876-911d555f086c None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:48.854428 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6567c-9dd5-4bc5-b876-911d555f086c None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:48.855089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6567c-9dd5-4bc5-b876-911d555f086c None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:48.855394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6567c-9dd5-4bc5-b876-911d555f086c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:48.856751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6567c-9dd5-4bc5-b876-911d555f086c None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:48.868438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 604/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:22:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:48.874397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30d9dd-ab24-4a95-b3ec-6e30348b65a0 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:48.926389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:48.980251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30d9dd-ab24-4a95-b3ec-6e30348b65a0 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:49.020559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a5e77-6a80-480b-a4bc-2a511b39114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:49.021450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a5e77-6a80-480b-a4bc-2a511b39114a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:49.021721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a5e77-6a80-480b-a4bc-2a511b39114a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:49.021920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a5e77-6a80-480b-a4bc-2a511b39114a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:49.034124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a5e77-6a80-480b-a4bc-2a511b39114a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:49.035925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a5e77-6a80-480b-a4bc-2a511b39114a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-9e9a5e77-6a80-480b-a4bc-2a511b39114a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:22:49.053817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:49.054851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:22:49.056814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:22:49.056814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:49.056814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:22:49.056814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 606/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:49.061350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6567c-9dd5-4bc5-b876-911d555f086c None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:49.172884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:49.177323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6567c-9dd5-4bc5-b876-911d555f086c None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:49.218268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973ae04-c69f-4206-870d-9cd544393b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:49.218953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973ae04-c69f-4206-870d-9cd544393b58 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:49.219223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973ae04-c69f-4206-870d-9cd544393b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:49.219517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973ae04-c69f-4206-870d-9cd544393b58 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:49.220209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973ae04-c69f-4206-870d-9cd544393b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:49.220522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973ae04-c69f-4206-870d-9cd544393b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:49.222038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973ae04-c69f-4206-870d-9cd544393b58 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:49.234868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 605/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:49.240588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a5e77-6a80-480b-a4bc-2a511b39114a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:49.345889 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a5e77-6a80-480b-a4bc-2a511b39114a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:49.347488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:49.393575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f7d94-594e-4768-8a4e-c079712b6417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:49.393969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f7d94-594e-4768-8a4e-c079712b6417 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:49.394338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f7d94-594e-4768-8a4e-c079712b6417 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:49.394522 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f7d94-594e-4768-8a4e-c079712b6417 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:49.403237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f7d94-594e-4768-8a4e-c079712b6417 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:49.404669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f7d94-594e-4768-8a4e-c079712b6417 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-303f7d94-594e-4768-8a4e-c079712b6417 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:22:49.417316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:49.418383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:49.419338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:49.419338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:49.419338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:22:49.419338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:22:49.419338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:22:49.419338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:22:49.419338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:22:49.419338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:22:49.419338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:22:49.419338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:22:49.426094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 607/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:22:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:49.426230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973ae04-c69f-4206-870d-9cd544393b58 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:49.538647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973ae04-c69f-4206-870d-9cd544393b58 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:49.573764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aefbd-3135-4206-889e-c582bdee276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:49.574385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aefbd-3135-4206-889e-c582bdee276f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:49.574682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aefbd-3135-4206-889e-c582bdee276f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:49.574995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aefbd-3135-4206-889e-c582bdee276f None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:49.575748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526aefbd-3135-4206-889e-c582bdee276f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:49.576059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526aefbd-3135-4206-889e-c582bdee276f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:49.577573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526aefbd-3135-4206-889e-c582bdee276f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:49.599538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 606/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 10:22:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:49.606235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f7d94-594e-4768-8a4e-c079712b6417 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:49.728900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f7d94-594e-4768-8a4e-c079712b6417 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:49.768372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07821c-36f6-4cb5-a57c-7a5f31954170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:49.769062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07821c-36f6-4cb5-a57c-7a5f31954170 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:49.769344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07821c-36f6-4cb5-a57c-7a5f31954170 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:49.769628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07821c-36f6-4cb5-a57c-7a5f31954170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:49.806803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:49.850566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07821c-36f6-4cb5-a57c-7a5f31954170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:49.852012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07821c-36f6-4cb5-a57c-7a5f31954170 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:49.966400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 608/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:22:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:22:49.974056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aefbd-3135-4206-889e-c582bdee276f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:49.995100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:50.096306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aefbd-3135-4206-889e-c582bdee276f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:50.130972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8916945-275a-4159-b9cc-28721290153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:50.131597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8916945-275a-4159-b9cc-28721290153a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:50.131873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8916945-275a-4159-b9cc-28721290153a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:50.132137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8916945-275a-4159-b9cc-28721290153a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:50.142535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8916945-275a-4159-b9cc-28721290153a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:50.144004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8916945-275a-4159-b9cc-28721290153a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-d8916945-275a-4159-b9cc-28721290153a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:22:50.159190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:50.160429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:22:50.161451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:22:50.161451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:50.161451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:22:50.161451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 607/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:50.166218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07821c-36f6-4cb5-a57c-7a5f31954170 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:50.244533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:50.291216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07821c-36f6-4cb5-a57c-7a5f31954170 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:50.331025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442ea97-4d02-4465-8bba-ca80a0b712ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:50.331664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ea97-4d02-4465-8bba-ca80a0b712ca None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:50.331971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ea97-4d02-4465-8bba-ca80a0b712ca None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:50.332239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ea97-4d02-4465-8bba-ca80a0b712ca None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:50.332892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442ea97-4d02-4465-8bba-ca80a0b712ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:50.333201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442ea97-4d02-4465-8bba-ca80a0b712ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:50.334591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442ea97-4d02-4465-8bba-ca80a0b712ca None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:50.346874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 609/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:50.352706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8916945-275a-4159-b9cc-28721290153a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:50.440045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:50.467793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8916945-275a-4159-b9cc-28721290153a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:50.504744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5180ee-2bb3-41af-89ba-c3c3605932d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:50.505398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5180ee-2bb3-41af-89ba-c3c3605932d2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:50.505685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5180ee-2bb3-41af-89ba-c3c3605932d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:50.505937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5180ee-2bb3-41af-89ba-c3c3605932d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:50.512667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5180ee-2bb3-41af-89ba-c3c3605932d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:50.514106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5180ee-2bb3-41af-89ba-c3c3605932d2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-7b5180ee-2bb3-41af-89ba-c3c3605932d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:22:50.529127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:50.530227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:50.531242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:22:50.531242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:22:50.531242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:22:50.531242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:22:50.531242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:22:50.531242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:22:50.531242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:22:50.531242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:22:50.533188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 608/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:50.539174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442ea97-4d02-4465-8bba-ca80a0b712ca None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:50.644207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442ea97-4d02-4465-8bba-ca80a0b712ca None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:50.671020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:50.688179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb1d85-fd4f-4a32-9584-0a50f8a2ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:50.688795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1d85-fd4f-4a32-9584-0a50f8a2ee6e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:50.689099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1d85-fd4f-4a32-9584-0a50f8a2ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:50.689400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1d85-fd4f-4a32-9584-0a50f8a2ee6e None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:50.690052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb1d85-fd4f-4a32-9584-0a50f8a2ee6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:50.690349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb1d85-fd4f-4a32-9584-0a50f8a2ee6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:50.691771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb1d85-fd4f-4a32-9584-0a50f8a2ee6e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:50.705830 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 610/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:22:50.712084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5180ee-2bb3-41af-89ba-c3c3605932d2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:50.829403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5180ee-2bb3-41af-89ba-c3c3605932d2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:50.864531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:50.870856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15915b-f79d-4cb7-83aa-286086af9849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:50.871688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15915b-f79d-4cb7-83aa-286086af9849 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:50.871984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15915b-f79d-4cb7-83aa-286086af9849 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:50.872474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15915b-f79d-4cb7-83aa-286086af9849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:50.873418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15915b-f79d-4cb7-83aa-286086af9849 None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=794990333d3748abad7683590b0e5d39) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:50.873792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15915b-f79d-4cb7-83aa-286086af9849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:50.875534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15915b-f79d-4cb7-83aa-286086af9849 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:50.886251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 609/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:22:50 2022] GET /identity/v3/role_assignments?user.id=794990333d3748abad7683590b0e5d39&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:53.068605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96512b81-2a34-4a1e-8978-155090c0f299 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:53.069193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96512b81-2a34-4a1e-8978-155090c0f299 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:53.069193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96512b81-2a34-4a1e-8978-155090c0f299 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:53.070523 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 611/1220] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:22:53.076715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78431a-5460-4dfe-8b15-1639338bc396 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:53.077188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78431a-5460-4dfe-8b15-1639338bc396 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:53.077282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78431a-5460-4dfe-8b15-1639338bc396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:53.098648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6b78431a-5460-4dfe-8b15-1639338bc396 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:22:53.100039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6b78431a-5460-4dfe-8b15-1639338bc396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:22:53.180043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 610/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:22:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:22:53.478660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96512b81-2a34-4a1e-8978-155090c0f299 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:53.593503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96512b81-2a34-4a1e-8978-155090c0f299 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:53.630617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e567-fdff-4f10-ac05-29c6c5bc778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:53.631165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e567-fdff-4f10-ac05-29c6c5bc778a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:53.631456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e567-fdff-4f10-ac05-29c6c5bc778a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:53.631709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e567-fdff-4f10-ac05-29c6c5bc778a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:53.642585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988e567-fdff-4f10-ac05-29c6c5bc778a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2988e567-fdff-4f10-ac05-29c6c5bc778a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:22:53.647301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:53.648450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:22:53.649443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 612/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:22:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:53.654849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78431a-5460-4dfe-8b15-1639338bc396 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:53.763302 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78431a-5460-4dfe-8b15-1639338bc396 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:53.787810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:53.799144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce806dc-30e0-4116-a56e-59e1980ce93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:53.799831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce806dc-30e0-4116-a56e-59e1980ce93e None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:53.800155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce806dc-30e0-4116-a56e-59e1980ce93e None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:53.800436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce806dc-30e0-4116-a56e-59e1980ce93e None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:53.801122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce806dc-30e0-4116-a56e-59e1980ce93e None admin] RBAC: Adding query filter params (name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:53.801431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce806dc-30e0-4116-a56e-59e1980ce93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:53.802801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce806dc-30e0-4116-a56e-59e1980ce93e None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:53.811915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 611/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:22:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:53.817821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e567-fdff-4f10-ac05-29c6c5bc778a None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:53.863935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:53.928810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e567-fdff-4f10-ac05-29c6c5bc778a None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:53.966083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6924-547a-4aae-99e7-ad89809c0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:53.966808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6924-547a-4aae-99e7-ad89809c0fbb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:53.967171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6924-547a-4aae-99e7-ad89809c0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:53.967451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6924-547a-4aae-99e7-ad89809c0fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:53.978305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b6924-547a-4aae-99e7-ad89809c0fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:53.979840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b6924-547a-4aae-99e7-ad89809c0fbb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-880b6924-547a-4aae-99e7-ad89809c0fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:22:53.995961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:53.997227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:22:53.998122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:22:53.998122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:53.998122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:22:53.998122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 613/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:22:54.003140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce806dc-30e0-4116-a56e-59e1980ce93e None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:54.116917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce806dc-30e0-4116-a56e-59e1980ce93e None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:54.150803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959c07-36e9-4abc-89d3-6e289ee323e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:54.151406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959c07-36e9-4abc-89d3-6e289ee323e5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:54.151682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959c07-36e9-4abc-89d3-6e289ee323e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:54.151997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959c07-36e9-4abc-89d3-6e289ee323e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:54.152731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959c07-36e9-4abc-89d3-6e289ee323e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:54.153167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959c07-36e9-4abc-89d3-6e289ee323e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:54.154657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959c07-36e9-4abc-89d3-6e289ee323e5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:54.168280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 612/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:54.174747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6924-547a-4aae-99e7-ad89809c0fbb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:54.280220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:54.287871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6924-547a-4aae-99e7-ad89809c0fbb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:54.327287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae29c1-0943-4c32-b9d6-3b889f27263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:54.328151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae29c1-0943-4c32-b9d6-3b889f27263d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:54.328423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae29c1-0943-4c32-b9d6-3b889f27263d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:54.328796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae29c1-0943-4c32-b9d6-3b889f27263d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:54.337737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae29c1-0943-4c32-b9d6-3b889f27263d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:54.339378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae29c1-0943-4c32-b9d6-3b889f27263d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-cfae29c1-0943-4c32-b9d6-3b889f27263d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:22:54.352016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:54.353777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:22:54.354871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 614/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:22:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:54.360196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959c07-36e9-4abc-89d3-6e289ee323e5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:54.413543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:54.474427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959c07-36e9-4abc-89d3-6e289ee323e5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:54.512743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88db567-3896-4a4d-999d-471d2f099b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:54.513439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88db567-3896-4a4d-999d-471d2f099b9f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:54.513665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88db567-3896-4a4d-999d-471d2f099b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:54.513971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88db567-3896-4a4d-999d-471d2f099b9f None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:54.514635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88db567-3896-4a4d-999d-471d2f099b9f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:54.514934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88db567-3896-4a4d-999d-471d2f099b9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:54.516349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88db567-3896-4a4d-999d-471d2f099b9f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:54.534669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 613/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 10:22:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:54.540742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae29c1-0943-4c32-b9d6-3b889f27263d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:54.644850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae29c1-0943-4c32-b9d6-3b889f27263d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:54.683485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c4ff0-85d4-4a5a-9d1e-64285b00223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:54.684110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4ff0-85d4-4a5a-9d1e-64285b00223b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:54.684398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4ff0-85d4-4a5a-9d1e-64285b00223b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:54.684701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c4ff0-85d4-4a5a-9d1e-64285b00223b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:54.696302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c4ff0-85d4-4a5a-9d1e-64285b00223b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:54.697754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c4ff0-85d4-4a5a-9d1e-64285b00223b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-be9c4ff0-85d4-4a5a-9d1e-64285b00223b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:22:54.712183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:54.713158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:22:54.714457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:22:54.714457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:54.714457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:22:54.714457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 615/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:54.719053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88db567-3896-4a4d-999d-471d2f099b9f None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:54.829244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88db567-3896-4a4d-999d-471d2f099b9f None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:54.831808 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:54.866417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec921794-7cbf-4568-b74c-a44e4d465529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:54.867061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921794-7cbf-4568-b74c-a44e4d465529 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:54.867344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921794-7cbf-4568-b74c-a44e4d465529 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:54.867692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921794-7cbf-4568-b74c-a44e4d465529 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:54.868931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec921794-7cbf-4568-b74c-a44e4d465529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:54.869266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec921794-7cbf-4568-b74c-a44e4d465529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:54.870630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec921794-7cbf-4568-b74c-a44e4d465529 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:54.882531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 614/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:54.888688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c4ff0-85d4-4a5a-9d1e-64285b00223b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:54.898466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:55.000197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c4ff0-85d4-4a5a-9d1e-64285b00223b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:55.041316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8ff6-0cc8-45ef-aa46-6835c306a059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:55.042227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8ff6-0cc8-45ef-aa46-6835c306a059 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:55.042569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8ff6-0cc8-45ef-aa46-6835c306a059 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:55.042945 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8ff6-0cc8-45ef-aa46-6835c306a059 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:55.050982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e8ff6-0cc8-45ef-aa46-6835c306a059 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:55.052711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e8ff6-0cc8-45ef-aa46-6835c306a059 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-e28e8ff6-0cc8-45ef-aa46-6835c306a059 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:22:55.065827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:55.066912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:55.068145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:22:55.068145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:22:55.068145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:22:55.068145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:22:55.068145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:22:55.068145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:22:55.068145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:22:55.068145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:22:55.068145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 616/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:22:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:55.073519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec921794-7cbf-4568-b74c-a44e4d465529 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:55.176375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec921794-7cbf-4568-b74c-a44e4d465529 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:55.209537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bbaf5-f829-4213-abd2-76bd0f9cabb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:55.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bbaf5-f829-4213-abd2-76bd0f9cabb8 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:55.210410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bbaf5-f829-4213-abd2-76bd0f9cabb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:55.210680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bbaf5-f829-4213-abd2-76bd0f9cabb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:55.211349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bbaf5-f829-4213-abd2-76bd0f9cabb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:55.212190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bbaf5-f829-4213-abd2-76bd0f9cabb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:55.213621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bbaf5-f829-4213-abd2-76bd0f9cabb8 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:55.225840 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 615/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:22:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:55.231748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8ff6-0cc8-45ef-aa46-6835c306a059 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:55.300894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:55.340673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8ff6-0cc8-45ef-aa46-6835c306a059 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:55.382917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd3fa9-27bb-46da-b33e-5867e1503874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:55.384222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd3fa9-27bb-46da-b33e-5867e1503874 None admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:55.384535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd3fa9-27bb-46da-b33e-5867e1503874 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:55.385167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd3fa9-27bb-46da-b33e-5867e1503874 None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/794990333d3748abad7683590b0e5d39/roles/c2bcddceaa5642beb73d7d1012bd46ec` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:55.400953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd3fa9-27bb-46da-b33e-5867e1503874 None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=794990333d3748abad7683590b0e5d39, role_id=c2bcddceaa5642beb73d7d1012bd46ec)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:55.402682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd3fa9-27bb-46da-b33e-5867e1503874 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:55.416006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 617/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:22:55 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/794990333d3748abad7683590b0e5d39/roles/c2bcddceaa5642beb73d7d1012bd46ec => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:22:57.637376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54da32-a681-4c4b-83f8-f169f8203ff0 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:57.637925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54da32-a681-4c4b-83f8-f169f8203ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:57.637925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54da32-a681-4c4b-83f8-f169f8203ff0 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:57.639447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 616/1233] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:22:57.644505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c786-f13d-4d7a-bdfd-16e582443a39 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:57.644908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c786-f13d-4d7a-bdfd-16e582443a39 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:57.645097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c786-f13d-4d7a-bdfd-16e582443a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:57.664234 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d205c786-f13d-4d7a-bdfd-16e582443a39 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:22:57.665492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d205c786-f13d-4d7a-bdfd-16e582443a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:22:57.741611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 618/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:22:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:22:58.023403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54da32-a681-4c4b-83f8-f169f8203ff0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:58.054922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:58.142731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54da32-a681-4c4b-83f8-f169f8203ff0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:58.185192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c918cf-0aa2-4b11-a270-40f1f92aef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:58.185901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c918cf-0aa2-4b11-a270-40f1f92aef0d None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:58.186185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c918cf-0aa2-4b11-a270-40f1f92aef0d None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:58.186546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c918cf-0aa2-4b11-a270-40f1f92aef0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:58.201979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c918cf-0aa2-4b11-a270-40f1f92aef0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a3c918cf-0aa2-4b11-a270-40f1f92aef0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:22:58.208981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:58.210133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:22:58.211124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 617/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 10:22:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:58.216483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c786-f13d-4d7a-bdfd-16e582443a39 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:58.269979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:58.327442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c786-f13d-4d7a-bdfd-16e582443a39 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:58.365005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16beff2-4ff1-467f-b871-435ae119014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:58.365646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16beff2-4ff1-467f-b871-435ae119014c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:58.365923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16beff2-4ff1-467f-b871-435ae119014c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:58.366193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16beff2-4ff1-467f-b871-435ae119014c None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:58.366856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16beff2-4ff1-467f-b871-435ae119014c None admin] RBAC: Adding query filter params (name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:58.367156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16beff2-4ff1-467f-b871-435ae119014c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:58.369137 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16beff2-4ff1-467f-b871-435ae119014c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:58.377848 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 619/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 10:22:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:58.384183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c918cf-0aa2-4b11-a270-40f1f92aef0d None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:58.476458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:58.493726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c918cf-0aa2-4b11-a270-40f1f92aef0d None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:58.528956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb3b50-f697-464c-a465-293592817c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:58.529606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb3b50-f697-464c-a465-293592817c0b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:58.529886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb3b50-f697-464c-a465-293592817c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:58.530158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb3b50-f697-464c-a465-293592817c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:58.540649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb3b50-f697-464c-a465-293592817c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:58.542116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb3b50-f697-464c-a465-293592817c0b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-dcbb3b50-f697-464c-a465-293592817c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:22:58.559378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:58.560587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:22:58.561509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:22:58.561509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:58.561509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:22:58.561509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 618/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:22:58.566482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16beff2-4ff1-467f-b871-435ae119014c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:58.677801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16beff2-4ff1-467f-b871-435ae119014c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:58.687191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:58.712849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b54fce-7ff1-42b2-b32b-95defc1c4e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:58.713487 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b54fce-7ff1-42b2-b32b-95defc1c4e71 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:58.713772 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b54fce-7ff1-42b2-b32b-95defc1c4e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:58.714050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b54fce-7ff1-42b2-b32b-95defc1c4e71 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:58.714692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b54fce-7ff1-42b2-b32b-95defc1c4e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:58.714998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b54fce-7ff1-42b2-b32b-95defc1c4e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:58.716365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b54fce-7ff1-42b2-b32b-95defc1c4e71 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:58.729695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 620/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:58.737261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb3b50-f697-464c-a465-293592817c0b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:58.842828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb3b50-f697-464c-a465-293592817c0b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:58.878471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1eccb-927d-42e2-92b0-b450c3945756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:58.879099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1eccb-927d-42e2-92b0-b450c3945756 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:58.879376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1eccb-927d-42e2-92b0-b450c3945756 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:58.879643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1eccb-927d-42e2-92b0-b450c3945756 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:58.883323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:58.888707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1eccb-927d-42e2-92b0-b450c3945756 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:58.890461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1eccb-927d-42e2-92b0-b450c3945756 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-37c1eccb-927d-42e2-92b0-b450c3945756 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:22:58.901414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:58.902482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:22:58.903480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 619/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:22:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:58.909668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b54fce-7ff1-42b2-b32b-95defc1c4e71 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:59.026741 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b54fce-7ff1-42b2-b32b-95defc1c4e71 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:59.064184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2a16-e042-4161-9f0e-28573754de94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:59.064823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2a16-e042-4161-9f0e-28573754de94 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:59.065100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2a16-e042-4161-9f0e-28573754de94 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:59.065371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2a16-e042-4161-9f0e-28573754de94 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:59.066089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2a16-e042-4161-9f0e-28573754de94 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:59.066397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2a16-e042-4161-9f0e-28573754de94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:59.067807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be2a16-e042-4161-9f0e-28573754de94 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:59.089977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 621/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 10:22:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:59.091296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1eccb-927d-42e2-92b0-b450c3945756 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:59.204458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1eccb-927d-42e2-92b0-b450c3945756 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:59.241423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad940ac2-390f-4cbb-8527-4dc160ca334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:59.242123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940ac2-390f-4cbb-8527-4dc160ca334b None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:59.242392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940ac2-390f-4cbb-8527-4dc160ca334b None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:59.242843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad940ac2-390f-4cbb-8527-4dc160ca334b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:59.313094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:59.321612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad940ac2-390f-4cbb-8527-4dc160ca334b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:59.323394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad940ac2-390f-4cbb-8527-4dc160ca334b None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:59.435901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 620/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:22:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:22:59.442989 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2a16-e042-4161-9f0e-28573754de94 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:59.471698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:59.548204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2a16-e042-4161-9f0e-28573754de94 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:59.584828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1490358-15f5-4d7c-985b-8b3fca7a04ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:59.585585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1490358-15f5-4d7c-985b-8b3fca7a04ca None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:59.585938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1490358-15f5-4d7c-985b-8b3fca7a04ca None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:59.586212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1490358-15f5-4d7c-985b-8b3fca7a04ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:59.596805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1490358-15f5-4d7c-985b-8b3fca7a04ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:59.598333 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1490358-15f5-4d7c-985b-8b3fca7a04ca None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-a1490358-15f5-4d7c-985b-8b3fca7a04ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:22:59.616664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:59.617943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:22:59.619438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:22:59.619438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:22:59.619438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:22:59.619438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 622/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:59.627294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad940ac2-390f-4cbb-8527-4dc160ca334b None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:59.735804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:59.743036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad940ac2-390f-4cbb-8527-4dc160ca334b None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:59.780559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac5e8a-3267-45b9-9f98-1c4d16fb0610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:59.781612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac5e8a-3267-45b9-9f98-1c4d16fb0610 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:59.781996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac5e8a-3267-45b9-9f98-1c4d16fb0610 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:59.782403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac5e8a-3267-45b9-9f98-1c4d16fb0610 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:59.783528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac5e8a-3267-45b9-9f98-1c4d16fb0610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:22:59.784015 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac5e8a-3267-45b9-9f98-1c4d16fb0610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:59.785568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac5e8a-3267-45b9-9f98-1c4d16fb0610 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:59.798812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 621/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:22:59.804636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1490358-15f5-4d7c-985b-8b3fca7a04ca None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:22:59.892684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:22:59.916931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1490358-15f5-4d7c-985b-8b3fca7a04ca None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:22:59.952672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc72b7-3a2e-4243-84a4-4dca56cc87fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:22:59.953339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc72b7-3a2e-4243-84a4-4dca56cc87fa None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:22:59.953658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc72b7-3a2e-4243-84a4-4dca56cc87fa None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:22:59.953938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc72b7-3a2e-4243-84a4-4dca56cc87fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:22:59.960767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc72b7-3a2e-4243-84a4-4dca56cc87fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:22:59.962268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc72b7-3a2e-4243-84a4-4dca56cc87fa None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-d4cc72b7-3a2e-4243-84a4-4dca56cc87fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:22:59.976242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:22:59.977259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:22:59.978219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:22:59.978219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:22:59.978219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:22:59.978219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:22:59.978219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:22:59.978219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:22:59.978219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:22:59.978219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:22:59.978219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 623/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:22:59.983467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac5e8a-3267-45b9-9f98-1c4d16fb0610 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:00.099464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac5e8a-3267-45b9-9f98-1c4d16fb0610 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:00.139850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f951d-4e1f-4367-a4a1-717f1b14cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:00.140659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f951d-4e1f-4367-a4a1-717f1b14cbea None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:00.141046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f951d-4e1f-4367-a4a1-717f1b14cbea None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:00.141395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f951d-4e1f-4367-a4a1-717f1b14cbea None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:00.142184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f951d-4e1f-4367-a4a1-717f1b14cbea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:00.142498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f951d-4e1f-4367-a4a1-717f1b14cbea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:00.144037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f951d-4e1f-4367-a4a1-717f1b14cbea None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:00.159469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 622/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:00.169579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc72b7-3a2e-4243-84a4-4dca56cc87fa None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:00.278019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc72b7-3a2e-4243-84a4-4dca56cc87fa None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:00.313583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f43162-d570-4aee-b5af-2cb4541783cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:00.314224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f43162-d570-4aee-b5af-2cb4541783cb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:00.314533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f43162-d570-4aee-b5af-2cb4541783cb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:00.314803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f43162-d570-4aee-b5af-2cb4541783cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:00.315597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f43162-d570-4aee-b5af-2cb4541783cb None admin] RBAC: Adding query filter params (role.id=c2bcddceaa5642beb73d7d1012bd46ec, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=794990333d3748abad7683590b0e5d39) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:00.315909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f43162-d570-4aee-b5af-2cb4541783cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:00.317451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f43162-d570-4aee-b5af-2cb4541783cb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:00.323876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 624/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:23:00 2022] GET /identity/v3/role_assignments?user.id=794990333d3748abad7683590b0e5d39&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=c2bcddceaa5642beb73d7d1012bd46ec => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:02.785058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74646c0-3100-453d-8e6d-8e8bb4767881 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:02.785599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74646c0-3100-453d-8e6d-8e8bb4767881 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:02.785599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74646c0-3100-453d-8e6d-8e8bb4767881 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:02.786856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 623/1247] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:23:02.797703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23824f1-48c1-4994-976e-26bc7c163c7e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:02.797703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23824f1-48c1-4994-976e-26bc7c163c7e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:02.797703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23824f1-48c1-4994-976e-26bc7c163c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:02.802086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:02.814771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b23824f1-48c1-4994-976e-26bc7c163c7e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:23:02.816013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b23824f1-48c1-4994-976e-26bc7c163c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:23:02.888190 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 625/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:23:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:23:03.158447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74646c0-3100-453d-8e6d-8e8bb4767881 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:03.179979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:03.273845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74646c0-3100-453d-8e6d-8e8bb4767881 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:03.310220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4168-f9b0-4070-b06c-80f9e484d834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:03.310969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4168-f9b0-4070-b06c-80f9e484d834 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:03.311342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4168-f9b0-4070-b06c-80f9e484d834 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:03.311761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4168-f9b0-4070-b06c-80f9e484d834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:03.324315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e4168-f9b0-4070-b06c-80f9e484d834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f54e4168-f9b0-4070-b06c-80f9e484d834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:23:03.330141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:03.331184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:23:03.332030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 624/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:03.337706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23824f1-48c1-4994-976e-26bc7c163c7e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:03.450493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23824f1-48c1-4994-976e-26bc7c163c7e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:03.481071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:03.486348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715cc1-d062-4a8a-aab9-616c93009dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:03.486957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715cc1-d062-4a8a-aab9-616c93009dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:03.487233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715cc1-d062-4a8a-aab9-616c93009dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:03.487504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715cc1-d062-4a8a-aab9-616c93009dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:03.488202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5715cc1-d062-4a8a-aab9-616c93009dc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:03.488591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5715cc1-d062-4a8a-aab9-616c93009dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:03.490045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5715cc1-d062-4a8a-aab9-616c93009dc7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:03.498724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 626/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:03.504863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4168-f9b0-4070-b06c-80f9e484d834 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:03.587366 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:03.614913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4168-f9b0-4070-b06c-80f9e484d834 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:03.652930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e810c4b-3917-45bb-a5a2-dce17b2d7012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:03.653866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e810c4b-3917-45bb-a5a2-dce17b2d7012 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:03.654343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e810c4b-3917-45bb-a5a2-dce17b2d7012 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:03.654864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e810c4b-3917-45bb-a5a2-dce17b2d7012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:03.668518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e810c4b-3917-45bb-a5a2-dce17b2d7012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:03.670017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e810c4b-3917-45bb-a5a2-dce17b2d7012 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-3e810c4b-3917-45bb-a5a2-dce17b2d7012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:23:03.685648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:03.686812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:23:03.687851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:23:03.687851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:03.687851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:23:03.687851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 625/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 10:23:03.692774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715cc1-d062-4a8a-aab9-616c93009dc7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:03.802557 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715cc1-d062-4a8a-aab9-616c93009dc7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:03.844338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e2174-930c-49c1-9058-834258700449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:03.844953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2174-930c-49c1-9058-834258700449 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:03.845300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2174-930c-49c1-9058-834258700449 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:03.845517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2174-930c-49c1-9058-834258700449 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:03.846151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e2174-930c-49c1-9058-834258700449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:03.846452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e2174-930c-49c1-9058-834258700449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:03.847863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e2174-930c-49c1-9058-834258700449 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:03.859896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 627/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:03.865787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e810c4b-3917-45bb-a5a2-dce17b2d7012 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:03.974787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e810c4b-3917-45bb-a5a2-dce17b2d7012 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:04.004527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:04.013895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb03fd7-d198-4f19-91cd-2b71cf1e14e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:04.014572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb03fd7-d198-4f19-91cd-2b71cf1e14e5 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:04.014874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb03fd7-d198-4f19-91cd-2b71cf1e14e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:04.015127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb03fd7-d198-4f19-91cd-2b71cf1e14e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:04.023058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb03fd7-d198-4f19-91cd-2b71cf1e14e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:04.024641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb03fd7-d198-4f19-91cd-2b71cf1e14e5 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-3cb03fd7-d198-4f19-91cd-2b71cf1e14e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:23:04.038372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:04.039622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:04.041411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:04.041411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:04.041411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:23:04.041411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:23:04.041411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:23:04.041411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:23:04.041411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:23:04.041411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:23:04.041411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:23:04.041411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:23:04.042859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 626/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:23:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:04.054653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e2174-930c-49c1-9058-834258700449 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:04.117672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:04.165663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e2174-930c-49c1-9058-834258700449 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:04.203097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296659e-ccc2-4b25-b588-790295ea9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:04.203721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296659e-ccc2-4b25-b588-790295ea9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:04.203998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296659e-ccc2-4b25-b588-790295ea9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:04.204266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296659e-ccc2-4b25-b588-790295ea9ab5 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:04.205045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296659e-ccc2-4b25-b588-790295ea9ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:04.205350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296659e-ccc2-4b25-b588-790295ea9ab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:04.206807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296659e-ccc2-4b25-b588-790295ea9ab5 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:04.226950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 628/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 10:23:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:04.233381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb03fd7-d198-4f19-91cd-2b71cf1e14e5 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:04.339682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb03fd7-d198-4f19-91cd-2b71cf1e14e5 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:04.380438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a1ce8-6337-4d9b-be87-9f36abd36f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:04.381086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a1ce8-6337-4d9b-be87-9f36abd36f76 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:04.381368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a1ce8-6337-4d9b-be87-9f36abd36f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:04.381638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a1ce8-6337-4d9b-be87-9f36abd36f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:04.447247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:04.459803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a1ce8-6337-4d9b-be87-9f36abd36f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:04.461281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a1ce8-6337-4d9b-be87-9f36abd36f76 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:04.559381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 627/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:23:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:23:04.565503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296659e-ccc2-4b25-b588-790295ea9ab5 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:04.666131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296659e-ccc2-4b25-b588-790295ea9ab5 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:04.680291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:04.702415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e0ae5-2ffa-41a5-ae23-dccda179d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:04.703054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e0ae5-2ffa-41a5-ae23-dccda179d06c None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:04.703335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e0ae5-2ffa-41a5-ae23-dccda179d06c None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:04.703609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e0ae5-2ffa-41a5-ae23-dccda179d06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:04.713375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e0ae5-2ffa-41a5-ae23-dccda179d06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:04.714843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e0ae5-2ffa-41a5-ae23-dccda179d06c None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-660e0ae5-2ffa-41a5-ae23-dccda179d06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:23:04.730840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:04.731963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:23:04.733119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:23:04.733119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:04.733119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:04.733119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 629/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:04.737829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a1ce8-6337-4d9b-be87-9f36abd36f76 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:04.822651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:04.836388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a1ce8-6337-4d9b-be87-9f36abd36f76 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:04.869918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef747142-f756-4712-b1f8-ffeb772b5a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:04.870514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef747142-f756-4712-b1f8-ffeb772b5a77 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:04.870778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef747142-f756-4712-b1f8-ffeb772b5a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:04.871045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef747142-f756-4712-b1f8-ffeb772b5a77 None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:04.871681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef747142-f756-4712-b1f8-ffeb772b5a77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:04.871983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef747142-f756-4712-b1f8-ffeb772b5a77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:04.873364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef747142-f756-4712-b1f8-ffeb772b5a77 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:04.884022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 628/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:04.889834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e0ae5-2ffa-41a5-ae23-dccda179d06c None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:04.986072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e0ae5-2ffa-41a5-ae23-dccda179d06c None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:05.020926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb7af9-4381-45d0-be96-e09cf9a9095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:05.021612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb7af9-4381-45d0-be96-e09cf9a9095e None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:05.021924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb7af9-4381-45d0-be96-e09cf9a9095e None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:05.022251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb7af9-4381-45d0-be96-e09cf9a9095e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:05.030106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb7af9-4381-45d0-be96-e09cf9a9095e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:05.031719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb7af9-4381-45d0-be96-e09cf9a9095e None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4fdb7af9-4381-45d0-be96-e09cf9a9095e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:23:05.044499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:05.045612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:05.046703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:23:05.046703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:23:05.046703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:23:05.046703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:23:05.046703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:23:05.046703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:23:05.046703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:23:05.046703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:05.046703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 630/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:23:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:05.051628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef747142-f756-4712-b1f8-ffeb772b5a77 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:05.152311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef747142-f756-4712-b1f8-ffeb772b5a77 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:05.184536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48213c-d957-4680-b0e7-2a0522f8b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:05.185160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48213c-d957-4680-b0e7-2a0522f8b0ef None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:05.185444 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48213c-d957-4680-b0e7-2a0522f8b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:05.185718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48213c-d957-4680-b0e7-2a0522f8b0ef None admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:05.186397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48213c-d957-4680-b0e7-2a0522f8b0ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:05.186703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48213c-d957-4680-b0e7-2a0522f8b0ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:05.188103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48213c-d957-4680-b0e7-2a0522f8b0ef None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:05.199448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 629/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:23:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:05.205793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb7af9-4381-45d0-be96-e09cf9a9095e None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:05.231464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:05.304325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb7af9-4381-45d0-be96-e09cf9a9095e None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:05.336408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f942c3-0c00-4774-8370-04f043833d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:05.337540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f942c3-0c00-4774-8370-04f043833d86 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:05.337823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f942c3-0c00-4774-8370-04f043833d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:05.338097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f942c3-0c00-4774-8370-04f043833d86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:05.338809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f942c3-0c00-4774-8370-04f043833d86 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=794990333d3748abad7683590b0e5d39) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:05.339118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f942c3-0c00-4774-8370-04f043833d86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:05.340530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f942c3-0c00-4774-8370-04f043833d86 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:05.345703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 631/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:23:05 2022] GET /identity/v3/role_assignments?user.id=794990333d3748abad7683590b0e5d39&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:07.460172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0667c1-8238-49ad-bbd1-633f5a700854 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:07.460722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0667c1-8238-49ad-bbd1-633f5a700854 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:07.460722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0667c1-8238-49ad-bbd1-633f5a700854 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:07.462628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 630/1261] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:23:07.467617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54285697-e2af-4326-a495-76d63f308e64 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:07.468038 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54285697-e2af-4326-a495-76d63f308e64 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:07.468202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54285697-e2af-4326-a495-76d63f308e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:07.487690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-54285697-e2af-4326-a495-76d63f308e64 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:23:07.488891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-54285697-e2af-4326-a495-76d63f308e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:23:07.554290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 632/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:23:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:23:07.817959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0667c1-8238-49ad-bbd1-633f5a700854 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:07.829065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:07.915845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0667c1-8238-49ad-bbd1-633f5a700854 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:07.947872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc502fe-9212-45fa-aa95-de5b5423f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:07.948480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc502fe-9212-45fa-aa95-de5b5423f775 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:07.948757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc502fe-9212-45fa-aa95-de5b5423f775 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:07.949053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc502fe-9212-45fa-aa95-de5b5423f775 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:07.958669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc502fe-9212-45fa-aa95-de5b5423f775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-0bc502fe-9212-45fa-aa95-de5b5423f775 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:23:07.963509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:07.964584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:23:07.965805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 631/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:23:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:07.970466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54285697-e2af-4326-a495-76d63f308e64 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:07.988508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:08.074160 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54285697-e2af-4326-a495-76d63f308e64 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:08.108495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18441b-d114-4ac8-b00f-9acc38216615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:08.109118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18441b-d114-4ac8-b00f-9acc38216615 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:08.109394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18441b-d114-4ac8-b00f-9acc38216615 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:08.109660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18441b-d114-4ac8-b00f-9acc38216615 None admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:08.110308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18441b-d114-4ac8-b00f-9acc38216615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:08.110606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18441b-d114-4ac8-b00f-9acc38216615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:08.111950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18441b-d114-4ac8-b00f-9acc38216615 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:08.120096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 633/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:23:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:08.125859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc502fe-9212-45fa-aa95-de5b5423f775 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:08.190496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:08.222863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc502fe-9212-45fa-aa95-de5b5423f775 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:08.255163 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719c4b-6731-4fc6-8947-aab132d8d8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:08.255768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719c4b-6731-4fc6-8947-aab132d8d8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:08.256054 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719c4b-6731-4fc6-8947-aab132d8d8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:08.256330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719c4b-6731-4fc6-8947-aab132d8d8a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:08.268541 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce719c4b-6731-4fc6-8947-aab132d8d8a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:08.270008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce719c4b-6731-4fc6-8947-aab132d8d8a1 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-ce719c4b-6731-4fc6-8947-aab132d8d8a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:23:08.287234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:08.288356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:23:08.289418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:23:08.289418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:08.289418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:23:08.289418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 632/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:08.294663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18441b-d114-4ac8-b00f-9acc38216615 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:08.372068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:08.390509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18441b-d114-4ac8-b00f-9acc38216615 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:08.423441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe9925-efe2-48c1-8d56-a114ed4b2620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:08.424025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe9925-efe2-48c1-8d56-a114ed4b2620 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:08.424300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe9925-efe2-48c1-8d56-a114ed4b2620 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:08.424568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe9925-efe2-48c1-8d56-a114ed4b2620 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:08.425228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe9925-efe2-48c1-8d56-a114ed4b2620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:08.425528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe9925-efe2-48c1-8d56-a114ed4b2620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:08.426870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe9925-efe2-48c1-8d56-a114ed4b2620 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:08.437972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 634/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:08.444085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719c4b-6731-4fc6-8947-aab132d8d8a1 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:08.544344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719c4b-6731-4fc6-8947-aab132d8d8a1 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:08.563385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:08.577961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4e73b-a84b-4e03-8087-3534de5e3dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:08.578580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4e73b-a84b-4e03-8087-3534de5e3dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:08.578863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4e73b-a84b-4e03-8087-3534de5e3dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:08.579136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4e73b-a84b-4e03-8087-3534de5e3dc2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:08.585850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4e73b-a84b-4e03-8087-3534de5e3dc2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:08.587887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4e73b-a84b-4e03-8087-3534de5e3dc2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-51c4e73b-a84b-4e03-8087-3534de5e3dc2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:23:08.599089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:08.600162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:23:08.601530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 633/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:23:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:08.606037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe9925-efe2-48c1-8d56-a114ed4b2620 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:08.702104 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe9925-efe2-48c1-8d56-a114ed4b2620 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:08.735546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aa58a-dd23-40c6-895a-7c25d1421eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:08.736142 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aa58a-dd23-40c6-895a-7c25d1421eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:08.736421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aa58a-dd23-40c6-895a-7c25d1421eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:08.736692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aa58a-dd23-40c6-895a-7c25d1421eb6 None admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:08.737455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aa58a-dd23-40c6-895a-7c25d1421eb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:08.737763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aa58a-dd23-40c6-895a-7c25d1421eb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:08.739173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aa58a-dd23-40c6-895a-7c25d1421eb6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:08.748159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:08.756687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 635/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 10:23:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:08.762526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4e73b-a84b-4e03-8087-3534de5e3dc2 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:08.861379 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4e73b-a84b-4e03-8087-3534de5e3dc2 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:08.893972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57f041-279b-43b5-8a6b-cd11ef4cc222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:08.894588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f041-279b-43b5-8a6b-cd11ef4cc222 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:08.894870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f041-279b-43b5-8a6b-cd11ef4cc222 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:08.895143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f041-279b-43b5-8a6b-cd11ef4cc222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:08.906070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57f041-279b-43b5-8a6b-cd11ef4cc222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:08.907492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57f041-279b-43b5-8a6b-cd11ef4cc222 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-7b57f041-279b-43b5-8a6b-cd11ef4cc222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:23:08.921971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:08.923087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:23:08.924156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:23:08.924156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:08.924156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:23:08.924156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 634/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:08.928752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aa58a-dd23-40c6-895a-7c25d1421eb6 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:09.027013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aa58a-dd23-40c6-895a-7c25d1421eb6 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:09.060288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b756c45-fb1d-44b9-8d79-478a0810d036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:09.060878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b756c45-fb1d-44b9-8d79-478a0810d036 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:09.061179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b756c45-fb1d-44b9-8d79-478a0810d036 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:09.061450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b756c45-fb1d-44b9-8d79-478a0810d036 None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:09.062075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b756c45-fb1d-44b9-8d79-478a0810d036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:09.062373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b756c45-fb1d-44b9-8d79-478a0810d036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:09.063713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b756c45-fb1d-44b9-8d79-478a0810d036 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:09.074330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 636/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:09.079954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57f041-279b-43b5-8a6b-cd11ef4cc222 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:09.111223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:09.178096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57f041-279b-43b5-8a6b-cd11ef4cc222 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:09.210029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0954b0a-498f-403e-aef4-3b194c534b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:09.210635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0954b0a-498f-403e-aef4-3b194c534b90 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:09.210916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0954b0a-498f-403e-aef4-3b194c534b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:09.211187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0954b0a-498f-403e-aef4-3b194c534b90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:09.218101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0954b0a-498f-403e-aef4-3b194c534b90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:09.219529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0954b0a-498f-403e-aef4-3b194c534b90 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-a0954b0a-498f-403e-aef4-3b194c534b90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:23:09.230317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:09.231171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:09.232152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:23:09.232152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:23:09.232152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:23:09.232152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:23:09.232152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:23:09.232152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:23:09.232152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:23:09.232152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:23:09.232152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 635/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:23:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:09.237202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b756c45-fb1d-44b9-8d79-478a0810d036 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:09.293287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:09.333877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b756c45-fb1d-44b9-8d79-478a0810d036 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:09.365819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37aec8-cca4-4b6b-9b34-62f3334fe4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:09.366414 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37aec8-cca4-4b6b-9b34-62f3334fe4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:09.367063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37aec8-cca4-4b6b-9b34-62f3334fe4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:09.367063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37aec8-cca4-4b6b-9b34-62f3334fe4e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:09.367611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37aec8-cca4-4b6b-9b34-62f3334fe4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:09.367911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37aec8-cca4-4b6b-9b34-62f3334fe4e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:09.369389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37aec8-cca4-4b6b-9b34-62f3334fe4e8 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:09.380865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 637/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:23:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:09.387241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0954b0a-498f-403e-aef4-3b194c534b90 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:09.475477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:09.484673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0954b0a-498f-403e-aef4-3b194c534b90 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:09.517208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be128da-cba6-4740-adcb-8532f9917b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:09.517851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be128da-cba6-4740-adcb-8532f9917b19 None admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:09.518133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be128da-cba6-4740-adcb-8532f9917b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:09.518411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be128da-cba6-4740-adcb-8532f9917b19 None admin] PATH_INFO: `/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/794990333d3748abad7683590b0e5d39/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:09.520275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be128da-cba6-4740-adcb-8532f9917b19 None admin] RBAC: Authorizing `identity:create_grant(project_id=2beda4474ea544dba1eee3f14ae299a8, user_id=794990333d3748abad7683590b0e5d39, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:09.521770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be128da-cba6-4740-adcb-8532f9917b19 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:09.534996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 636/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 10:23:09 2022] PUT /identity/v3/projects/2beda4474ea544dba1eee3f14ae299a8/users/794990333d3748abad7683590b0e5d39/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:23:11.614721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542557f-6ef1-4cbf-a6c8-62b2ed7d06bd None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:11.615239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542557f-6ef1-4cbf-a6c8-62b2ed7d06bd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:11.615239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542557f-6ef1-4cbf-a6c8-62b2ed7d06bd None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:11.616617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 638/1274] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:23:11.621820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012321-6354-4275-88ad-8240ef1048a0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:11.622206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012321-6354-4275-88ad-8240ef1048a0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:11.622379 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012321-6354-4275-88ad-8240ef1048a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:11.640472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0d012321-6354-4275-88ad-8240ef1048a0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:23:11.641683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0d012321-6354-4275-88ad-8240ef1048a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:23:11.706153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 637/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:23:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:23:11.971189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542557f-6ef1-4cbf-a6c8-62b2ed7d06bd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:12.084875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542557f-6ef1-4cbf-a6c8-62b2ed7d06bd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:12.102682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:12.120141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3704-597e-4929-a68a-e0896feccb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:12.120766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3704-597e-4929-a68a-e0896feccb20 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:12.121072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3704-597e-4929-a68a-e0896feccb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:12.121345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3704-597e-4929-a68a-e0896feccb20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:12.131138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f3704-597e-4929-a68a-e0896feccb20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-0d9f3704-597e-4929-a68a-e0896feccb20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 10:23:12.136543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:12.137530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:12.138394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 639/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 10:23:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:12.143825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012321-6354-4275-88ad-8240ef1048a0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:12.219590 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:12.238276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012321-6354-4275-88ad-8240ef1048a0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:12.270327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b88724-87cb-4525-99c0-930fe8ec0730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:12.270920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b88724-87cb-4525-99c0-930fe8ec0730 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:12.271198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b88724-87cb-4525-99c0-930fe8ec0730 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:12.271466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b88724-87cb-4525-99c0-930fe8ec0730 None admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:12.272118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b88724-87cb-4525-99c0-930fe8ec0730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:12.272419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b88724-87cb-4525-99c0-930fe8ec0730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:12.273907 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b88724-87cb-4525-99c0-930fe8ec0730 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:12.281647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 638/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 10:23:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:12.287667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3704-597e-4929-a68a-e0896feccb20 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:12.384318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3704-597e-4929-a68a-e0896feccb20 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:12.417690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd6182-ec36-4331-ab20-547a20b85408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:12.418303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd6182-ec36-4331-ab20-547a20b85408 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:12.418578 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd6182-ec36-4331-ab20-547a20b85408 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:12.418846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd6182-ec36-4331-ab20-547a20b85408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:12.428351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd6182-ec36-4331-ab20-547a20b85408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:12.429791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd6182-ec36-4331-ab20-547a20b85408 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-2ecd6182-ec36-4331-ab20-547a20b85408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:23:12.443844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:12.445021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:23:12.445910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:23:12.445910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:12.445910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:12.445910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 640/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:12.451257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b88724-87cb-4525-99c0-930fe8ec0730 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:12.545242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b88724-87cb-4525-99c0-930fe8ec0730 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:12.577051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cb236-a0dd-4548-85e6-d144a03215dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:12.577635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cb236-a0dd-4548-85e6-d144a03215dd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:12.577910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cb236-a0dd-4548-85e6-d144a03215dd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:12.578178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cb236-a0dd-4548-85e6-d144a03215dd None admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:12.578801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cb236-a0dd-4548-85e6-d144a03215dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:12.579097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cb236-a0dd-4548-85e6-d144a03215dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:12.580418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cb236-a0dd-4548-85e6-d144a03215dd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:12.591357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 639/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:12.596846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd6182-ec36-4331-ab20-547a20b85408 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:12.626601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:12.693697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd6182-ec36-4331-ab20-547a20b85408 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:12.725914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625b61a-8447-4d2f-80a4-fe7a1501cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:12.726526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625b61a-8447-4d2f-80a4-fe7a1501cf4b None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:12.726807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625b61a-8447-4d2f-80a4-fe7a1501cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:12.727076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625b61a-8447-4d2f-80a4-fe7a1501cf4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:12.734281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625b61a-8447-4d2f-80a4-fe7a1501cf4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:12.735699 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625b61a-8447-4d2f-80a4-fe7a1501cf4b None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-c625b61a-8447-4d2f-80a4-fe7a1501cf4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 10:23:12.747135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:12.748233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:12.749405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 641/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:23:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:12.753958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cb236-a0dd-4548-85e6-d144a03215dd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:12.757704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:12.849427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cb236-a0dd-4548-85e6-d144a03215dd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:12.881037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea9e58-e2cb-47f3-a3eb-b38ad620b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:12.881623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9e58-e2cb-47f3-a3eb-b38ad620b0bd None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:12.881899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9e58-e2cb-47f3-a3eb-b38ad620b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:12.882168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9e58-e2cb-47f3-a3eb-b38ad620b0bd None admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:12.882873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea9e58-e2cb-47f3-a3eb-b38ad620b0bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:12.883173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea9e58-e2cb-47f3-a3eb-b38ad620b0bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:12.884639 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea9e58-e2cb-47f3-a3eb-b38ad620b0bd None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:12.901030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 640/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 10:23:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:12.906691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625b61a-8447-4d2f-80a4-fe7a1501cf4b None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:12.993350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:13.002738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625b61a-8447-4d2f-80a4-fe7a1501cf4b None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:13.038351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b42e1d-acb3-463b-9a42-722bd9b8e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:13.038938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b42e1d-acb3-463b-9a42-722bd9b8e912 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:13.039220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b42e1d-acb3-463b-9a42-722bd9b8e912 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:13.039483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b42e1d-acb3-463b-9a42-722bd9b8e912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:13.103780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b42e1d-acb3-463b-9a42-722bd9b8e912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:13.105165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b42e1d-acb3-463b-9a42-722bd9b8e912 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:13.189956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:13.200304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 642/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 10:23:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 10:23:13.206127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea9e58-e2cb-47f3-a3eb-b38ad620b0bd None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:13.264080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:13.300861 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea9e58-e2cb-47f3-a3eb-b38ad620b0bd None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:13.333580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce8596-60bc-46a4-a2e7-cea328a9c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:13.334197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8596-60bc-46a4-a2e7-cea328a9c80a None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:13.334477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8596-60bc-46a4-a2e7-cea328a9c80a None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:13.334749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8596-60bc-46a4-a2e7-cea328a9c80a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:13.344288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce8596-60bc-46a4-a2e7-cea328a9c80a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:13.345748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce8596-60bc-46a4-a2e7-cea328a9c80a None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-85ce8596-60bc-46a4-a2e7-cea328a9c80a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 10:23:13.359862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:13.361032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 10:23:13.361928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 10:23:13.361928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 10:23:13.361928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:23:13.361928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 641/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:13.366708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b42e1d-acb3-463b-9a42-722bd9b8e912 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:13.463154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b42e1d-acb3-463b-9a42-722bd9b8e912 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:13.495607 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a03f1-3151-4683-b9c6-51513c93d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:13.496210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a03f1-3151-4683-b9c6-51513c93d8fb None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:13.496489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a03f1-3151-4683-b9c6-51513c93d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:13.496761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a03f1-3151-4683-b9c6-51513c93d8fb None admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:13.497420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a03f1-3151-4683-b9c6-51513c93d8fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:13.497722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a03f1-3151-4683-b9c6-51513c93d8fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:13.499080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a03f1-3151-4683-b9c6-51513c93d8fb None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:13.510429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 643/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 10:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:13.516092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce8596-60bc-46a4-a2e7-cea328a9c80a None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:13.611285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce8596-60bc-46a4-a2e7-cea328a9c80a None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:13.624416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:13.644369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25a0c-adb7-4ff3-b7e8-a7f3ddfae316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:13.644993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25a0c-adb7-4ff3-b7e8-a7f3ddfae316 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:13.645274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25a0c-adb7-4ff3-b7e8-a7f3ddfae316 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:13.645543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25a0c-adb7-4ff3-b7e8-a7f3ddfae316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:13.651988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b25a0c-adb7-4ff3-b7e8-a7f3ddfae316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:13.653441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b25a0c-adb7-4ff3-b7e8-a7f3ddfae316 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application [None req-f6b25a0c-adb7-4ff3-b7e8-a7f3ddfae316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 10:23:13.664448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:13.666023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:13.667097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 10:23:13.667097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 10:23:13.667097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 10:23:13.667097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 10:23:13.667097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 10:23:13.667097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 10:23:13.667097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 10:23:13.667097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: ERROR keystone.server.flask.application Sep 26 10:23:13.667097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 642/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 10:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:13.671699 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a03f1-3151-4683-b9c6-51513c93d8fb None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:13.719040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:13.767529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a03f1-3151-4683-b9c6-51513c93d8fb None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:13.800268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905afbd-db42-4697-a3f4-0e9d3b07240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:13.800865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905afbd-db42-4697-a3f4-0e9d3b07240a None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:13.801176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905afbd-db42-4697-a3f4-0e9d3b07240a None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:13.801447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905afbd-db42-4697-a3f4-0e9d3b07240a None admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:13.802126 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905afbd-db42-4697-a3f4-0e9d3b07240a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:13.802432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905afbd-db42-4697-a3f4-0e9d3b07240a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:13.803842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905afbd-db42-4697-a3f4-0e9d3b07240a None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:13.815969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 644/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 10:23:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:13.822018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25a0c-adb7-4ff3-b7e8-a7f3ddfae316 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:13.915738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25a0c-adb7-4ff3-b7e8-a7f3ddfae316 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:13.947124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bcf37-05d7-40fb-aa9b-2f5b929a50f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:13.947699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcf37-05d7-40fb-aa9b-2f5b929a50f2 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:13.947973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcf37-05d7-40fb-aa9b-2f5b929a50f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:13.948242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcf37-05d7-40fb-aa9b-2f5b929a50f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:13.948966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bcf37-05d7-40fb-aa9b-2f5b929a50f2 None admin] RBAC: Adding query filter params (role.id=9017bb819fd54a179e1ae8585a831e88, scope.project.id=2beda4474ea544dba1eee3f14ae299a8, user.id=794990333d3748abad7683590b0e5d39) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:13.949273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bcf37-05d7-40fb-aa9b-2f5b929a50f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:13.950645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bcf37-05d7-40fb-aa9b-2f5b929a50f2 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:13.956085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 643/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 10:23:13 2022] GET /identity/v3/role_assignments?user.id=794990333d3748abad7683590b0e5d39&scope.project.id=2beda4474ea544dba1eee3f14ae299a8&role.id=9017bb819fd54a179e1ae8585a831e88 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:16.159646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c8f1a-43b3-4fc4-8fe1-ddef596bc989 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:16.160177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c8f1a-43b3-4fc4-8fe1-ddef596bc989 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:16.160177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c8f1a-43b3-4fc4-8fe1-ddef596bc989 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:16.161538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 645/1288] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:23:16.167089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a0fc-f7f2-4a55-a98b-0ef2c5d77ed0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:16.167466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a0fc-f7f2-4a55-a98b-0ef2c5d77ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:16.167628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a0fc-f7f2-4a55-a98b-0ef2c5d77ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:16.185744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5483a0fc-f7f2-4a55-a98b-0ef2c5d77ed0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:23:16.186928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5483a0fc-f7f2-4a55-a98b-0ef2c5d77ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:23:16.214409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:16.251358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 644/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:23:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:23:16.513350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c8f1a-43b3-4fc4-8fe1-ddef596bc989 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:16.611343 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c8f1a-43b3-4fc4-8fe1-ddef596bc989 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:16.621990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:16.645057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496edfb-76db-47ae-b0d2-0558414fec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:16.645671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496edfb-76db-47ae-b0d2-0558414fec9d None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:16.645952 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496edfb-76db-47ae-b0d2-0558414fec9d None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:16.646227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496edfb-76db-47ae-b0d2-0558414fec9d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:16.646801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496edfb-76db-47ae-b0d2-0558414fec9d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:16.648156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496edfb-76db-47ae-b0d2-0558414fec9d None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-5496edfb-76db-47ae-b0d2-0558414fec9d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:16.656847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:16.657866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:16.659081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 646/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 10:23:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:16.664102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483a0fc-f7f2-4a55-a98b-0ef2c5d77ed0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:16.757836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483a0fc-f7f2-4a55-a98b-0ef2c5d77ed0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:16.789754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7740e-fc7a-42d3-b730-802a877df716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:16.790807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7740e-fc7a-42d3-b730-802a877df716 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:16.791083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7740e-fc7a-42d3-b730-802a877df716 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:16.791350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7740e-fc7a-42d3-b730-802a877df716 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:16.791967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7740e-fc7a-42d3-b730-802a877df716 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:16.792266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7740e-fc7a-42d3-b730-802a877df716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:16.793623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7740e-fc7a-42d3-b730-802a877df716 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:16.798206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 645/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Sep 26 10:23:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:16.803684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496edfb-76db-47ae-b0d2-0558414fec9d None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:16.902168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496edfb-76db-47ae-b0d2-0558414fec9d None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:16.934632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d56d6-ec81-4c97-9620-400d6fedc5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:16.935215 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d56d6-ec81-4c97-9620-400d6fedc5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:16.935495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d56d6-ec81-4c97-9620-400d6fedc5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:16.935763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d56d6-ec81-4c97-9620-400d6fedc5f6 None admin] PATH_INFO: `/v3/services` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:16.936375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d56d6-ec81-4c97-9620-400d6fedc5f6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:16.936672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d56d6-ec81-4c97-9620-400d6fedc5f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:16.938034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d56d6-ec81-4c97-9620-400d6fedc5f6 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:16.942198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 647/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Sep 26 10:23:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:23:19.055291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d02c-b26f-4341-840c-de3d87812069 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:19.056195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d02c-b26f-4341-840c-de3d87812069 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:19.056195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d02c-b26f-4341-840c-de3d87812069 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:19.057239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 646/1293] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:23:19.062985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec33e-d290-4df7-b2a2-6c38b6247e13 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:19.063483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec33e-d290-4df7-b2a2-6c38b6247e13 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:19.063613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec33e-d290-4df7-b2a2-6c38b6247e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:19.084382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2d2ec33e-d290-4df7-b2a2-6c38b6247e13 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:23:19.085715 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2d2ec33e-d290-4df7-b2a2-6c38b6247e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:23:19.119197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:19.155520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 648/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:23:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:23:19.420377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d02c-b26f-4341-840c-de3d87812069 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:19.451113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:19.517974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d02c-b26f-4341-840c-de3d87812069 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:19.549713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814421a-3622-4d52-81e7-2cdd3db28202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:19.550297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814421a-3622-4d52-81e7-2cdd3db28202 None admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:19.550572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814421a-3622-4d52-81e7-2cdd3db28202 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:19.550839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814421a-3622-4d52-81e7-2cdd3db28202 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:19.551468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814421a-3622-4d52-81e7-2cdd3db28202 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:19.552799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814421a-3622-4d52-81e7-2cdd3db28202 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:19.566548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 647/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 10:23:19 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:23:21.693233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269467-6a53-4f65-a48b-ad66b1037b34 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:21.693723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269467-6a53-4f65-a48b-ad66b1037b34 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:21.693723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269467-6a53-4f65-a48b-ad66b1037b34 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:21.695030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 649/1296] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:23:21.700210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d4b3-097c-4c24-a1b4-cac6283d94e0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:21.700640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d4b3-097c-4c24-a1b4-cac6283d94e0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:21.700761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d4b3-097c-4c24-a1b4-cac6283d94e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:21.718748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-01b8d4b3-097c-4c24-a1b4-cac6283d94e0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:23:21.719903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-01b8d4b3-097c-4c24-a1b4-cac6283d94e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:23:21.789217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 648/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:23:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:23:22.059721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84269467-6a53-4f65-a48b-ad66b1037b34 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:22.157489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84269467-6a53-4f65-a48b-ad66b1037b34 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:22.194138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74e45e-9d92-4312-8b9a-9161f903a472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:22.194763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74e45e-9d92-4312-8b9a-9161f903a472 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:22.195043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74e45e-9d92-4312-8b9a-9161f903a472 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:22.195319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74e45e-9d92-4312-8b9a-9161f903a472 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:22.195894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74e45e-9d92-4312-8b9a-9161f903a472 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:22.197324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74e45e-9d92-4312-8b9a-9161f903a472 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-8a74e45e-9d92-4312-8b9a-9161f903a472 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:22.206043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:22.207203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:22.208238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 650/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 10:23:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:22.213397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8d4b3-097c-4c24-a1b4-cac6283d94e0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:22.231255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:22.309177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8d4b3-097c-4c24-a1b4-cac6283d94e0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:22.341515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f473cd-5d5d-4f65-a697-2faa893f7494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:22.342109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f473cd-5d5d-4f65-a697-2faa893f7494 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:22.342387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f473cd-5d5d-4f65-a697-2faa893f7494 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:22.342660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f473cd-5d5d-4f65-a697-2faa893f7494 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:22.343283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f473cd-5d5d-4f65-a697-2faa893f7494 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:22.343587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f473cd-5d5d-4f65-a697-2faa893f7494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:22.344932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f473cd-5d5d-4f65-a697-2faa893f7494 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:22.349858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 649/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Sep 26 10:23:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:22.357335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74e45e-9d92-4312-8b9a-9161f903a472 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:22.388844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:22.456117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74e45e-9d92-4312-8b9a-9161f903a472 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:22.489359 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94932c7-e30a-45bd-907d-596d05c781bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:22.489955 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94932c7-e30a-45bd-907d-596d05c781bf None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:22.490236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94932c7-e30a-45bd-907d-596d05c781bf None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:22.490510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94932c7-e30a-45bd-907d-596d05c781bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:22.491199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94932c7-e30a-45bd-907d-596d05c781bf None admin] RBAC: Adding query filter params (interface=public, service_id=e065b2152cd8402a8c0085e09e80b1a9, region_id=RegionOne) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:22.491512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94932c7-e30a-45bd-907d-596d05c781bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:22.492871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94932c7-e30a-45bd-907d-596d05c781bf None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:22.497794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 651/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 10:23:22 2022] GET /identity/v3/endpoints?service_id=e065b2152cd8402a8c0085e09e80b1a9&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:22.503531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f473cd-5d5d-4f65-a697-2faa893f7494 None admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:22.591711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:22.610285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f473cd-5d5d-4f65-a697-2faa893f7494 None admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:22.641980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b78eb1-36a5-470a-a320-b7df655e72a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:22.642574 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b78eb1-36a5-470a-a320-b7df655e72a9 None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:22.642856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b78eb1-36a5-470a-a320-b7df655e72a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:22.643125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b78eb1-36a5-470a-a320-b7df655e72a9 None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:22.643719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b78eb1-36a5-470a-a320-b7df655e72a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:22.645089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b78eb1-36a5-470a-a320-b7df655e72a9 None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:22.652223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 650/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 10:23:22 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:23:24.784839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844083-dd26-4d83-b6bd-51938a4eb09b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:24.785397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844083-dd26-4d83-b6bd-51938a4eb09b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:24.785397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844083-dd26-4d83-b6bd-51938a4eb09b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:24.786689 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 652/1302] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:23:24.792055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188f73f-b6e7-400b-9481-dfcc5015ff6d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:24.792496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188f73f-b6e7-400b-9481-dfcc5015ff6d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:24.792614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188f73f-b6e7-400b-9481-dfcc5015ff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:24.810713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9188f73f-b6e7-400b-9481-dfcc5015ff6d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:23:24.811890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9188f73f-b6e7-400b-9481-dfcc5015ff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:23:24.875453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 651/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:23:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 10:23:25.144079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d844083-dd26-4d83-b6bd-51938a4eb09b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:25.237261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:25.244712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d844083-dd26-4d83-b6bd-51938a4eb09b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:25.277084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54ca07-17a5-43be-8fb2-77184f0e98b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:25.277701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54ca07-17a5-43be-8fb2-77184f0e98b7 None admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:25.277981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54ca07-17a5-43be-8fb2-77184f0e98b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:25.278253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54ca07-17a5-43be-8fb2-77184f0e98b7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:25.278824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54ca07-17a5-43be-8fb2-77184f0e98b7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:25.280197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54ca07-17a5-43be-8fb2-77184f0e98b7 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application [None req-4c54ca07-17a5-43be-8fb2-77184f0e98b7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 10:23:25.289069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 10:23:25.290821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application with Lock( Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self._enter() Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application return self.creator() Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application created_value = creator( Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: ERROR keystone.server.flask.application Sep 26 10:23:25.291670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 653/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 10:23:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 10:23:25.296713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188f73f-b6e7-400b-9481-dfcc5015ff6d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:25.369470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:25.391126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188f73f-b6e7-400b-9481-dfcc5015ff6d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:25.423983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87785e-ea8e-470d-87b6-95a2fe7e038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:25.424515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87785e-ea8e-470d-87b6-95a2fe7e038f None admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:25.424792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87785e-ea8e-470d-87b6-95a2fe7e038f None admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:25.425090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87785e-ea8e-470d-87b6-95a2fe7e038f None admin] PATH_INFO: `/v3/services` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:25.425708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87785e-ea8e-470d-87b6-95a2fe7e038f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:23:25.426006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87785e-ea8e-470d-87b6-95a2fe7e038f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:25.427340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87785e-ea8e-470d-87b6-95a2fe7e038f None admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:25.432227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 652/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Sep 26 10:23:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:23:25.437989 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54ca07-17a5-43be-8fb2-77184f0e98b7 None admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:23:25.534601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54ca07-17a5-43be-8fb2-77184f0e98b7 None admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:23:25.571866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0fe2e-1741-480e-87ad-41c6e8a584c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:23:25.572464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0fe2e-1741-480e-87ad-41c6e8a584c2 None admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:23:25.572740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0fe2e-1741-480e-87ad-41c6e8a584c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:23:25.573037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0fe2e-1741-480e-87ad-41c6e8a584c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:23:25.573693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0fe2e-1741-480e-87ad-41c6e8a584c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:23:25.575042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0fe2e-1741-480e-87ad-41c6e8a584c2 None admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:23:25.594678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 654/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:23:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:23:35.429755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=30 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:23:35.590828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:29.361315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f932-2750-4ebb-a599-e934c36f4d90 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:29.361759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f932-2750-4ebb-a599-e934c36f4d90 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:29.361759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f932-2750-4ebb-a599-e934c36f4d90 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:29.367071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 653/1307] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:24:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:29.368475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2692df-b306-4806-a6cf-20417e7965cd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:29.368873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2692df-b306-4806-a6cf-20417e7965cd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:29.369085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2692df-b306-4806-a6cf-20417e7965cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:29.498281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bb2692df-b306-4806-a6cf-20417e7965cd None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:29.499759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bb2692df-b306-4806-a6cf-20417e7965cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:29.610437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 655/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:24:29.903661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2cd05-bb71-4794-b21d-2158551db4f1 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:29.904077 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2cd05-bb71-4794-b21d-2158551db4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:29.904426 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2cd05-bb71-4794-b21d-2158551db4f1 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:29.908370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 654/1309] 10.222.0.18 () {54 vars in 964 bytes} [Mon Sep 26 10:24:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:29.915610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fcd19-c974-4a4b-802e-53d6c36bbf01 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:29.915913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fcd19-c974-4a4b-802e-53d6c36bbf01 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:29.916193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fcd19-c974-4a4b-802e-53d6c36bbf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:30.003533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0d8fcd19-c974-4a4b-802e-53d6c36bbf01 None None] MFA Rules not processed for user `ad0f25125b534983af66d5326f4d626d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:30.004754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0d8fcd19-c974-4a4b-802e-53d6c36bbf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:30.030682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:30.094810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 656/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Sep 26 10:24:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:24:30.104492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2cd05-bb71-4794-b21d-2158551db4f1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:24:30.106414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-46d2cd05-bb71-4794-b21d-2158551db4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:30.233018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2cd05-bb71-4794-b21d-2158551db4f1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:24:30.315277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad890dab-0220-4e99-b44a-d198db6ce55b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:24:30.315894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890dab-0220-4e99-b44a-d198db6ce55b service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:30.316291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890dab-0220-4e99-b44a-d198db6ce55b service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:30.316565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890dab-0220-4e99-b44a-d198db6ce55b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:30.318203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ad890dab-0220-4e99-b44a-d198db6ce55b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:30.381016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:30.441199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad890dab-0220-4e99-b44a-d198db6ce55b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:24:30.442630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad890dab-0220-4e99-b44a-d198db6ce55b service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:24:30.462173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 655/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:24:32.904649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286f64-149b-4bc2-b5ef-3736a91b9757 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:32.905249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286f64-149b-4bc2-b5ef-3736a91b9757 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:32.905249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286f64-149b-4bc2-b5ef-3736a91b9757 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:32.906486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 657/1312] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:32.911731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd72f58-6543-4737-b9c4-d142c39bfc39 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:32.912163 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd72f58-6543-4737-b9c4-d142c39bfc39 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:32.912283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd72f58-6543-4737-b9c4-d142c39bfc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:32.993292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4dd72f58-6543-4737-b9c4-d142c39bfc39 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:32.994523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4dd72f58-6543-4737-b9c4-d142c39bfc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:33.092537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 656/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:24:33.390906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1347-20cd-4c67-a066-c8af56cd9660 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:33.391191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1347-20cd-4c67-a066-c8af56cd9660 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:33.391473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1347-20cd-4c67-a066-c8af56cd9660 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:33.393025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 658/1314] 10.222.0.18 () {54 vars in 964 bytes} [Mon Sep 26 10:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:33.399124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4c062-a4ac-4ef6-adb8-2a42fed08969 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:33.399482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4c062-a4ac-4ef6-adb8-2a42fed08969 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:33.399828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4c062-a4ac-4ef6-adb8-2a42fed08969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:33.414083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:33.479434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-75c4c062-a4ac-4ef6-adb8-2a42fed08969 None None] MFA Rules not processed for user `ad0f25125b534983af66d5326f4d626d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:33.480670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-75c4c062-a4ac-4ef6-adb8-2a42fed08969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:33.555390 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 657/1315] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Sep 26 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:24:33.564475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1347-20cd-4c67-a066-c8af56cd9660 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:24:33.566076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bd7a1347-20cd-4c67-a066-c8af56cd9660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:33.668458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1347-20cd-4c67-a066-c8af56cd9660 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:24:33.741177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:33.744019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de26ec-f842-4127-bab1-3914e09a9933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:24:33.745294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de26ec-f842-4127-bab1-3914e09a9933 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:33.745782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de26ec-f842-4127-bab1-3914e09a9933 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:33.746225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de26ec-f842-4127-bab1-3914e09a9933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:33.748146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-66de26ec-f842-4127-bab1-3914e09a9933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:33.864808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de26ec-f842-4127-bab1-3914e09a9933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:24:33.866287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de26ec-f842-4127-bab1-3914e09a9933 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:24:33.885811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 659/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:24:36.555758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b60a6-e27e-4305-902d-bd98f26a5795 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:36.556311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b60a6-e27e-4305-902d-bd98f26a5795 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:36.556311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b60a6-e27e-4305-902d-bd98f26a5795 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:36.558256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 658/1317] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:36.563321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcad15-97a5-4143-9043-7006d92dd3ba None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:36.563764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcad15-97a5-4143-9043-7006d92dd3ba None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:36.563874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcad15-97a5-4143-9043-7006d92dd3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:36.630619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a9bcad15-97a5-4143-9043-7006d92dd3ba None None] MFA Rules not processed for user `06e92989261641b38e78bcbed08924de`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:36.631724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a9bcad15-97a5-4143-9043-7006d92dd3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:36.682203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:36.725538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 660/1318] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:24:37.018337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b60a6-e27e-4305-902d-bd98f26a5795 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:24:37.019887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e68b60a6-e27e-4305-902d-bd98f26a5795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:37.121121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b60a6-e27e-4305-902d-bd98f26a5795 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:24:37.123884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:37.194040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e5100-0672-4a9f-86d7-5f791d82c1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:24:37.194640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5100-0672-4a9f-86d7-5f791d82c1ad service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:37.194919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5100-0672-4a9f-86d7-5f791d82c1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:37.195190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5100-0672-4a9f-86d7-5f791d82c1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:37.196760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-983e5100-0672-4a9f-86d7-5f791d82c1ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:37.301622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e5100-0672-4a9f-86d7-5f791d82c1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:24:37.302966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e5100-0672-4a9f-86d7-5f791d82c1ad service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:24:37.321544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 659/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:24:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:24:39.987005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d8c8b-1c16-4970-8e75-cdc8badc373c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:39.987571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d8c8b-1c16-4970-8e75-cdc8badc373c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:39.987571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d8c8b-1c16-4970-8e75-cdc8badc373c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:39.988901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 661/1320] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:39.994189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d0a7a-f178-43dc-a8ef-b895a4f7e92f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:39.994640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d0a7a-f178-43dc-a8ef-b895a4f7e92f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:39.994776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d0a7a-f178-43dc-a8ef-b895a4f7e92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:40.037853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:40.062664 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ad3d0a7a-f178-43dc-a8ef-b895a4f7e92f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:40.063856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ad3d0a7a-f178-43dc-a8ef-b895a4f7e92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:40.157844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 660/1321] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:24:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:24:40.441708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d8c8b-1c16-4970-8e75-cdc8badc373c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:24:40.443226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-db5d8c8b-1c16-4970-8e75-cdc8badc373c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:40.542705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d8c8b-1c16-4970-8e75-cdc8badc373c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:24:40.613824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d29167-afea-4b43-acae-b7b8b771fed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:24:40.614424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d29167-afea-4b43-acae-b7b8b771fed1 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:40.614706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d29167-afea-4b43-acae-b7b8b771fed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:40.614976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d29167-afea-4b43-acae-b7b8b771fed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:40.616599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e3d29167-afea-4b43-acae-b7b8b771fed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:40.623806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:40.724651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d29167-afea-4b43-acae-b7b8b771fed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:24:40.726122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d29167-afea-4b43-acae-b7b8b771fed1 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:24:40.745213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 662/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:24:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:24:43.529125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbe09b-062e-480a-bdfe-6806e9454a13 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:43.529942 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbe09b-062e-480a-bdfe-6806e9454a13 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:43.529942 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbe09b-062e-480a-bdfe-6806e9454a13 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:43.531189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 661/1323] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:43.537950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb39dbd-7987-47d1-a446-7cb526419f63 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:43.538778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb39dbd-7987-47d1-a446-7cb526419f63 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:43.539281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb39dbd-7987-47d1-a446-7cb526419f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:43.612753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-efb39dbd-7987-47d1-a446-7cb526419f63 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:43.614032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-efb39dbd-7987-47d1-a446-7cb526419f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:43.676331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:43.718118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 663/1324] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:24:44.005195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbe09b-062e-480a-bdfe-6806e9454a13 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:24:44.006705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a5dbe09b-062e-480a-bdfe-6806e9454a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:44.108578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbe09b-062e-480a-bdfe-6806e9454a13 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:24:44.121977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:44.183933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760bed2-3f2a-433e-8ff0-19f93308db6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:24:44.184577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760bed2-3f2a-433e-8ff0-19f93308db6c service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:44.184855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760bed2-3f2a-433e-8ff0-19f93308db6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:44.185159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760bed2-3f2a-433e-8ff0-19f93308db6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:44.186784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4760bed2-3f2a-433e-8ff0-19f93308db6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:44.295422 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760bed2-3f2a-433e-8ff0-19f93308db6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:24:44.296751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760bed2-3f2a-433e-8ff0-19f93308db6c service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:24:44.315367 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 662/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:24:46.532448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601b835-69d3-404f-818a-8e047da60adf None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:46.533003 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601b835-69d3-404f-818a-8e047da60adf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:46.533100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601b835-69d3-404f-818a-8e047da60adf None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:46.534385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 664/1326] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:46.539902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365fe55-7fff-47e7-98e7-a353c2354ecc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:46.540353 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365fe55-7fff-47e7-98e7-a353c2354ecc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:46.540543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365fe55-7fff-47e7-98e7-a353c2354ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:46.590667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:46.608970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6365fe55-7fff-47e7-98e7-a353c2354ecc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:46.610209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6365fe55-7fff-47e7-98e7-a353c2354ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:46.714729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 663/1327] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:24:46.993280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601b835-69d3-404f-818a-8e047da60adf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:24:46.995688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1601b835-69d3-404f-818a-8e047da60adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:47.098494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601b835-69d3-404f-818a-8e047da60adf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:24:47.172014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949140e-e4de-41f1-9be5-e6cd80c2efe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:24:47.172618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949140e-e4de-41f1-9be5-e6cd80c2efe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:47.172896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949140e-e4de-41f1-9be5-e6cd80c2efe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:47.173198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949140e-e4de-41f1-9be5-e6cd80c2efe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:47.174771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c949140e-e4de-41f1-9be5-e6cd80c2efe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:47.193134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:47.284997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949140e-e4de-41f1-9be5-e6cd80c2efe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:24:47.286345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949140e-e4de-41f1-9be5-e6cd80c2efe5 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:24:47.304666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 665/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:24:49.509004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d10880-1419-4267-939c-8855441bce60 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:49.509562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d10880-1419-4267-939c-8855441bce60 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:49.509562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d10880-1419-4267-939c-8855441bce60 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:49.510825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 664/1329] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:49.516232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b16ee-d339-4eb1-a665-e70b51d6675b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:49.516642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b16ee-d339-4eb1-a665-e70b51d6675b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:49.516754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b16ee-d339-4eb1-a665-e70b51d6675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:49.582798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-672b16ee-d339-4eb1-a665-e70b51d6675b None None] MFA Rules not processed for user `06e92989261641b38e78bcbed08924de`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:49.583989 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-672b16ee-d339-4eb1-a665-e70b51d6675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:49.648349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:49.681700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 666/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:24:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:24:49.963062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d10880-1419-4267-939c-8855441bce60 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:24:49.964623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f3d10880-1419-4267-939c-8855441bce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:50.071016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d10880-1419-4267-939c-8855441bce60 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:24:50.091771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:50.152404 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2588d41-63f2-42e4-81a6-ca02e49609e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:24:50.153039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2588d41-63f2-42e4-81a6-ca02e49609e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:50.153324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2588d41-63f2-42e4-81a6-ca02e49609e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:50.153597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2588d41-63f2-42e4-81a6-ca02e49609e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:50.155170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c2588d41-63f2-42e4-81a6-ca02e49609e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:50.261143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2588d41-63f2-42e4-81a6-ca02e49609e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:24:50.262555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2588d41-63f2-42e4-81a6-ca02e49609e9 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:24:50.280722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 665/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:24:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:24:52.637354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedccf0-e7c3-4d6a-bc2e-2c2b5ee52df2 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:52.637875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedccf0-e7c3-4d6a-bc2e-2c2b5ee52df2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:52.637875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedccf0-e7c3-4d6a-bc2e-2c2b5ee52df2 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:52.639147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 667/1332] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:52.644320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b3ff-c417-4394-9694-c804a6a02429 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:52.644736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b3ff-c417-4394-9694-c804a6a02429 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:52.644871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b3ff-c417-4394-9694-c804a6a02429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:52.708220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:52.711342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2a90b3ff-c417-4394-9694-c804a6a02429 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:52.713185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2a90b3ff-c417-4394-9694-c804a6a02429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:52.810600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 666/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:24:53.089874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedccf0-e7c3-4d6a-bc2e-2c2b5ee52df2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:24:53.091392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9bedccf0-e7c3-4d6a-bc2e-2c2b5ee52df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:53.191195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedccf0-e7c3-4d6a-bc2e-2c2b5ee52df2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:24:53.263120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b76ae-d7bf-477d-aad9-4de5ee88e168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:24:53.263716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b76ae-d7bf-477d-aad9-4de5ee88e168 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:53.263992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b76ae-d7bf-477d-aad9-4de5ee88e168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:53.264262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b76ae-d7bf-477d-aad9-4de5ee88e168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:53.265887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2a4b76ae-d7bf-477d-aad9-4de5ee88e168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:53.297542 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:53.381212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b76ae-d7bf-477d-aad9-4de5ee88e168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:24:53.382661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b76ae-d7bf-477d-aad9-4de5ee88e168 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:24:53.400760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 668/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:24:55.593260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdff941-b1cb-4dde-a836-0ef0fa70a462 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:55.593816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdff941-b1cb-4dde-a836-0ef0fa70a462 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:55.593816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdff941-b1cb-4dde-a836-0ef0fa70a462 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:55.595183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 667/1335] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:55.600422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c641b0-401b-4707-b57e-177558d04635 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:55.600826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c641b0-401b-4707-b57e-177558d04635 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:55.600993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c641b0-401b-4707-b57e-177558d04635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:55.669411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-48c641b0-401b-4707-b57e-177558d04635 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:55.670538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-48c641b0-401b-4707-b57e-177558d04635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:55.742951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:55.765193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 669/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:24:56.048566 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdff941-b1cb-4dde-a836-0ef0fa70a462 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:24:56.050393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bbdff941-b1cb-4dde-a836-0ef0fa70a462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:56.152237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdff941-b1cb-4dde-a836-0ef0fa70a462 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:24:56.179792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:56.224354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d85d4-ddc7-4005-ba49-5229c616309b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:24:56.225002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d85d4-ddc7-4005-ba49-5229c616309b service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:56.225285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d85d4-ddc7-4005-ba49-5229c616309b service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:56.225556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d85d4-ddc7-4005-ba49-5229c616309b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:56.227129 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8f7d85d4-ddc7-4005-ba49-5229c616309b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:56.332632 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d85d4-ddc7-4005-ba49-5229c616309b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:24:56.334103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d85d4-ddc7-4005-ba49-5229c616309b service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:24:56.351747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 668/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:24:58.819254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2d7a-2f63-4d9e-b160-ebfc2a9b6872 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:58.819774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2d7a-2f63-4d9e-b160-ebfc2a9b6872 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:58.819774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2d7a-2f63-4d9e-b160-ebfc2a9b6872 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:58.821149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 670/1338] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:24:58.826351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ce85f-e39f-46b9-a381-38303b996492 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:58.826784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ce85f-e39f-46b9-a381-38303b996492 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:58.826902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ce85f-e39f-46b9-a381-38303b996492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:58.891655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-780ce85f-e39f-46b9-a381-38303b996492 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:24:58.892862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-780ce85f-e39f-46b9-a381-38303b996492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:58.900868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:58.991784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 669/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:24:59.282023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb2d7a-2f63-4d9e-b160-ebfc2a9b6872 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:24:59.283537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-baeb2d7a-2f63-4d9e-b160-ebfc2a9b6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:59.386085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb2d7a-2f63-4d9e-b160-ebfc2a9b6872 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:24:59.466094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409257d7-87a8-4a7e-b2db-c1c60112f71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:24:59.466703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409257d7-87a8-4a7e-b2db-c1c60112f71c service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:24:59.466985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409257d7-87a8-4a7e-b2db-c1c60112f71c service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:24:59.467266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409257d7-87a8-4a7e-b2db-c1c60112f71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:24:59.468849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-409257d7-87a8-4a7e-b2db-c1c60112f71c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:24:59.504307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:24:59.577394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409257d7-87a8-4a7e-b2db-c1c60112f71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:24:59.578818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409257d7-87a8-4a7e-b2db-c1c60112f71c service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:24:59.596460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 671/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:24:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:25:03.610807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d766f-5694-49ac-8d3a-77ab23e411f5 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:03.611343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d766f-5694-49ac-8d3a-77ab23e411f5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:03.611343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d766f-5694-49ac-8d3a-77ab23e411f5 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:03.612651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 670/1341] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:03.618116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047c5b-9d0f-4faa-b464-abfcc9a6a886 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:03.618583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047c5b-9d0f-4faa-b464-abfcc9a6a886 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:03.618683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67047c5b-9d0f-4faa-b464-abfcc9a6a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:03.697741 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-67047c5b-9d0f-4faa-b464-abfcc9a6a886 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:03.699769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-67047c5b-9d0f-4faa-b464-abfcc9a6a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:03.796615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:03.811648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 672/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:04.100096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d766f-5694-49ac-8d3a-77ab23e411f5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:04.101757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-807d766f-5694-49ac-8d3a-77ab23e411f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:04.207385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d766f-5694-49ac-8d3a-77ab23e411f5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:04.246306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:04.282133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df4346-182e-4b1e-865e-5b131eeddd37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:04.282745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df4346-182e-4b1e-865e-5b131eeddd37 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:04.283028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df4346-182e-4b1e-865e-5b131eeddd37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:04.283303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df4346-182e-4b1e-865e-5b131eeddd37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:04.284882 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a8df4346-182e-4b1e-865e-5b131eeddd37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:04.402959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df4346-182e-4b1e-865e-5b131eeddd37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:04.404379 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df4346-182e-4b1e-865e-5b131eeddd37 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:04.424094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 671/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:07.211073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63226284-e021-4b9b-a178-e3d53cb83ab3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:07.211626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63226284-e021-4b9b-a178-e3d53cb83ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:07.211718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63226284-e021-4b9b-a178-e3d53cb83ab3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:07.213043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 673/1344] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:07.218993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b181bf-469a-4f64-b30e-e02359c29cbf None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:07.219444 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b181bf-469a-4f64-b30e-e02359c29cbf None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:07.219647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b181bf-469a-4f64-b30e-e02359c29cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:07.284211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-18b181bf-469a-4f64-b30e-e02359c29cbf None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:07.285443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-18b181bf-469a-4f64-b30e-e02359c29cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:07.303325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:07.389649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 672/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:07.672008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63226284-e021-4b9b-a178-e3d53cb83ab3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:07.673537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-63226284-e021-4b9b-a178-e3d53cb83ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:07.782769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63226284-e021-4b9b-a178-e3d53cb83ab3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:07.857022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904b8f2-d487-47d5-827e-0daca90e2438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:07.857623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904b8f2-d487-47d5-827e-0daca90e2438 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:07.857900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904b8f2-d487-47d5-827e-0daca90e2438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:07.858168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904b8f2-d487-47d5-827e-0daca90e2438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:07.859715 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3904b8f2-d487-47d5-827e-0daca90e2438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:07.902354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:07.969425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904b8f2-d487-47d5-827e-0daca90e2438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:07.970998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904b8f2-d487-47d5-827e-0daca90e2438 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:07.990745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 674/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:12.129128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20bc55-6781-46f5-b0e3-8d8dec896b27 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:12.129578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20bc55-6781-46f5-b0e3-8d8dec896b27 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:12.129682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20bc55-6781-46f5-b0e3-8d8dec896b27 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:12.131078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 673/1347] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:12.136515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70755b-c26e-4fba-a6fd-eb342ca65d1a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:12.136910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70755b-c26e-4fba-a6fd-eb342ca65d1a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:12.137121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70755b-c26e-4fba-a6fd-eb342ca65d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:12.203134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7c70755b-c26e-4fba-a6fd-eb342ca65d1a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:12.204334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7c70755b-c26e-4fba-a6fd-eb342ca65d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:12.296482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:12.298685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 675/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:12.580477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20bc55-6781-46f5-b0e3-8d8dec896b27 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:12.582102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4f20bc55-6781-46f5-b0e3-8d8dec896b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:12.685320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20bc55-6781-46f5-b0e3-8d8dec896b27 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:12.733238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:12.762252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e7624-dd85-46bf-a760-60881203d279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:12.762873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7624-dd85-46bf-a760-60881203d279 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:12.763154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7624-dd85-46bf-a760-60881203d279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:12.763426 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e7624-dd85-46bf-a760-60881203d279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:12.765058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3d5e7624-dd85-46bf-a760-60881203d279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:12.882681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e7624-dd85-46bf-a760-60881203d279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:12.884124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e7624-dd85-46bf-a760-60881203d279 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:12.902940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 674/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:17.797068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d04a0-abed-4611-a0b8-97318ba6d584 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:17.797497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d04a0-abed-4611-a0b8-97318ba6d584 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:17.797603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d04a0-abed-4611-a0b8-97318ba6d584 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:17.799524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 676/1350] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:17.805123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5390-8a5c-489f-af3a-d916174d9c7d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:17.805531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5390-8a5c-489f-af3a-d916174d9c7d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:17.805738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5390-8a5c-489f-af3a-d916174d9c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:17.954344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d96c5390-8a5c-489f-af3a-d916174d9c7d None None] MFA Rules not processed for user `794990333d3748abad7683590b0e5d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:17.955477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d96c5390-8a5c-489f-af3a-d916174d9c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:17.986318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:18.098467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 675/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:22.190906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bbb36-ae51-48c4-981a-1c01edee03a3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:22.191388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bbb36-ae51-48c4-981a-1c01edee03a3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:22.191467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bbb36-ae51-48c4-981a-1c01edee03a3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:22.192982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 677/1352] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:22.199327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a9d0-01c0-4b3c-bcc0-5566a54c4972 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:22.200189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a9d0-01c0-4b3c-bcc0-5566a54c4972 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:22.200674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a9d0-01c0-4b3c-bcc0-5566a54c4972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:22.282299 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4952a9d0-01c0-4b3c-bcc0-5566a54c4972 None None] MFA Rules not processed for user `794990333d3748abad7683590b0e5d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:22.283511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4952a9d0-01c0-4b3c-bcc0-5566a54c4972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:22.360315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:22.400289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 676/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:23.709457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee3ba3-3b2e-48ae-be2b-12b82308b1b9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:23.709961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee3ba3-3b2e-48ae-be2b-12b82308b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:23.709961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee3ba3-3b2e-48ae-be2b-12b82308b1b9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:23.711230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 678/1354] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:23.716221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5edc5-7f4a-4963-bc57-96a9a1c60612 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:23.716643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5edc5-7f4a-4963-bc57-96a9a1c60612 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:23.716836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5edc5-7f4a-4963-bc57-96a9a1c60612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:23.796006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-69a5edc5-7f4a-4963-bc57-96a9a1c60612 None None] MFA Rules not processed for user `794990333d3748abad7683590b0e5d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:23.797270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-69a5edc5-7f4a-4963-bc57-96a9a1c60612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:23.904507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 677/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:27.545685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2ce1-bcdc-47dc-bc5f-f76c0680af91 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:27.546188 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2ce1-bcdc-47dc-bc5f-f76c0680af91 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:27.546375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2ce1-bcdc-47dc-bc5f-f76c0680af91 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:27.547803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 679/1356] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:25:27.553389 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beff586-641f-4913-83ee-46a4f591e149 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:27.553851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beff586-641f-4913-83ee-46a4f591e149 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:27.554058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beff586-641f-4913-83ee-46a4f591e149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:27.593791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:27.626119 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3beff586-641f-4913-83ee-46a4f591e149 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:27.627359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3beff586-641f-4913-83ee-46a4f591e149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:27.726182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 678/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:25:28.032823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1ca12-764d-4d4f-b037-f2999debc4db None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:28.033446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1ca12-764d-4d4f-b037-f2999debc4db None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:28.033963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1ca12-764d-4d4f-b037-f2999debc4db None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:28.035816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 680/1358] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 10:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:28.045334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de08a6-7eb0-4d54-af4d-0e634ac07f91 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:28.045623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de08a6-7eb0-4d54-af4d-0e634ac07f91 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:28.045899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de08a6-7eb0-4d54-af4d-0e634ac07f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:28.133565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-02de08a6-7eb0-4d54-af4d-0e634ac07f91 None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:28.134981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-02de08a6-7eb0-4d54-af4d-0e634ac07f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:28.187039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:28.259817 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 679/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:28.268026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1ca12-764d-4d4f-b037-f2999debc4db None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:28.269715 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-59b1ca12-764d-4d4f-b037-f2999debc4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:28.436927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1ca12-764d-4d4f-b037-f2999debc4db None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:28.511452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:28.552971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d96ef6-a28a-4a1a-ad86-17dcb10a5dcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:28.553570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96ef6-a28a-4a1a-ad86-17dcb10a5dcf service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:28.553845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96ef6-a28a-4a1a-ad86-17dcb10a5dcf service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:28.554112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96ef6-a28a-4a1a-ad86-17dcb10a5dcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:28.555677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d9d96ef6-a28a-4a1a-ad86-17dcb10a5dcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:28.664429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d96ef6-a28a-4a1a-ad86-17dcb10a5dcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:28.666398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d96ef6-a28a-4a1a-ad86-17dcb10a5dcf service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:28.685893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 681/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:31.058648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7f193-4c0e-4f1f-bc2f-67c071b8cb76 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:31.059208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7f193-4c0e-4f1f-bc2f-67c071b8cb76 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:31.059208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7f193-4c0e-4f1f-bc2f-67c071b8cb76 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:31.060477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 680/1361] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:31.066053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba32ea-4665-495c-87dd-eb4c87ac22ae None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:31.066483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba32ea-4665-495c-87dd-eb4c87ac22ae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:31.066606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba32ea-4665-495c-87dd-eb4c87ac22ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:31.168429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6cba32ea-4665-495c-87dd-eb4c87ac22ae None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:31.169780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6cba32ea-4665-495c-87dd-eb4c87ac22ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:31.213276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:31.277880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 682/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:31.569382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7f193-4c0e-4f1f-bc2f-67c071b8cb76 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:31.570947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5fb7f193-4c0e-4f1f-bc2f-67c071b8cb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:31.750433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7f193-4c0e-4f1f-bc2f-67c071b8cb76 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:31.763036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:31.885927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa800552-a397-476a-a3e6-0d29dd761c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:31.886517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800552-a397-476a-a3e6-0d29dd761c23 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:31.886794 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800552-a397-476a-a3e6-0d29dd761c23 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:31.887063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800552-a397-476a-a3e6-0d29dd761c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:31.888644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fa800552-a397-476a-a3e6-0d29dd761c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:31.983874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa800552-a397-476a-a3e6-0d29dd761c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:31.985517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa800552-a397-476a-a3e6-0d29dd761c23 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:32.003260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 681/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:34.497629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb8a47-4470-4b48-902f-de1030174a28 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:34.498206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb8a47-4470-4b48-902f-de1030174a28 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:34.498206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb8a47-4470-4b48-902f-de1030174a28 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:34.499434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 683/1364] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:34.504865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fab11-4d6d-4e81-aa40-f8c219e68a66 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:34.505340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fab11-4d6d-4e81-aa40-f8c219e68a66 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:34.505435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fab11-4d6d-4e81-aa40-f8c219e68a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:34.521376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:34.574911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e62fab11-4d6d-4e81-aa40-f8c219e68a66 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:34.576105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e62fab11-4d6d-4e81-aa40-f8c219e68a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:34.678374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 682/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:34.975332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe085d5-e9f9-4d9c-aaab-97c7433897f4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:34.975728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe085d5-e9f9-4d9c-aaab-97c7433897f4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:34.976008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe085d5-e9f9-4d9c-aaab-97c7433897f4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:34.977712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 684/1366] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 10:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:34.983574 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0613a6-185f-4d6e-b5dd-facccf08ab82 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:34.983868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0613a6-185f-4d6e-b5dd-facccf08ab82 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:34.984148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0613a6-185f-4d6e-b5dd-facccf08ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:35.071556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4e0613a6-185f-4d6e-b5dd-facccf08ab82 None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:35.072777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4e0613a6-185f-4d6e-b5dd-facccf08ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:35.226664 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:35.314176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 683/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:35.321917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe085d5-e9f9-4d9c-aaab-97c7433897f4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:35.323410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5fe085d5-e9f9-4d9c-aaab-97c7433897f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:35.483974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe085d5-e9f9-4d9c-aaab-97c7433897f4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:35.505258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:35.608806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8899b-1553-457f-9fe0-deefead4d999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:35.609626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8899b-1553-457f-9fe0-deefead4d999 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:35.610001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8899b-1553-457f-9fe0-deefead4d999 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:35.610429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8899b-1553-457f-9fe0-deefead4d999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:35.612383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ffe8899b-1553-457f-9fe0-deefead4d999 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:35.711354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8899b-1553-457f-9fe0-deefead4d999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:35.713129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8899b-1553-457f-9fe0-deefead4d999 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:35.719107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516068-ab21-414e-93c0-b53ce6c3f6f6 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:35.719593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516068-ab21-414e-93c0-b53ce6c3f6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:35.719701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516068-ab21-414e-93c0-b53ce6c3f6f6 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:35.721174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 684/1368] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:35.725918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81281a9-e664-42d8-bbd3-11ca83082d81 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:35.726204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81281a9-e664-42d8-bbd3-11ca83082d81 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:35.726481 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81281a9-e664-42d8-bbd3-11ca83082d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:35.735169 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 685/1369] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:35.798081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f81281a9-e664-42d8-bbd3-11ca83082d81 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:35.799283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f81281a9-e664-42d8-bbd3-11ca83082d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:35.911227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:35.920720 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 685/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:25:36.253586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b078e-33f4-4c2f-91fe-ae2c53337a98 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:36.253586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b078e-33f4-4c2f-91fe-ae2c53337a98 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:36.253586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b078e-33f4-4c2f-91fe-ae2c53337a98 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:36.256368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 686/1371] 10.222.0.18 () {54 vars in 963 bytes} [Mon Sep 26 10:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:36.259073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a612ad-4833-4725-a86f-55f05622c713 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:36.259369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a612ad-4833-4725-a86f-55f05622c713 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:36.259650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a612ad-4833-4725-a86f-55f05622c713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:36.340644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-40a612ad-4833-4725-a86f-55f05622c713 None None] MFA Rules not processed for user `561dd954e4184662b33ca3356aa08d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:36.341892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-40a612ad-4833-4725-a86f-55f05622c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:36.426340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 686/1372] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Sep 26 10:25:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:36.435100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b078e-33f4-4c2f-91fe-ae2c53337a98 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:36.436737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b18b078e-33f4-4c2f-91fe-ae2c53337a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:36.467495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:36.550819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b078e-33f4-4c2f-91fe-ae2c53337a98 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:36.633092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329093e7-5dc2-4cd2-a7a7-dd762096803b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:36.634135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329093e7-5dc2-4cd2-a7a7-dd762096803b service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:36.634579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329093e7-5dc2-4cd2-a7a7-dd762096803b service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:36.634836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329093e7-5dc2-4cd2-a7a7-dd762096803b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:36.637763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-329093e7-5dc2-4cd2-a7a7-dd762096803b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:36.749005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:36.797686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329093e7-5dc2-4cd2-a7a7-dd762096803b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:36.799457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329093e7-5dc2-4cd2-a7a7-dd762096803b service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:36.822559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 687/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:37.966996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a952-ba1f-4ca5-b57d-28911d65c607 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:37.967558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a952-ba1f-4ca5-b57d-28911d65c607 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:37.967669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a952-ba1f-4ca5-b57d-28911d65c607 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:37.969084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 687/1374] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:37.974416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebd7ae-b4fe-4b0f-9448-4dcf3a1831fc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:37.974883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebd7ae-b4fe-4b0f-9448-4dcf3a1831fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:37.975098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebd7ae-b4fe-4b0f-9448-4dcf3a1831fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:38.046959 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-27ebd7ae-b4fe-4b0f-9448-4dcf3a1831fc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:38.048185 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-27ebd7ae-b4fe-4b0f-9448-4dcf3a1831fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:38.144864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 688/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:38.438989 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90a952-ba1f-4ca5-b57d-28911d65c607 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:38.440507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9f90a952-ba1f-4ca5-b57d-28911d65c607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:38.530159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:38.593601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90a952-ba1f-4ca5-b57d-28911d65c607 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:38.707924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652df0d-cf10-4986-93bc-5156fc28bdd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:38.708977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652df0d-cf10-4986-93bc-5156fc28bdd3 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:38.708977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652df0d-cf10-4986-93bc-5156fc28bdd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:38.709268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652df0d-cf10-4986-93bc-5156fc28bdd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:38.710975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5652df0d-cf10-4986-93bc-5156fc28bdd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:38.765611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:38.809340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652df0d-cf10-4986-93bc-5156fc28bdd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:38.811002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652df0d-cf10-4986-93bc-5156fc28bdd3 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:38.830326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 688/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:41.050840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6abc0a-6cb6-4ad5-8f1f-6ee817d2a942 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:41.051377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6abc0a-6cb6-4ad5-8f1f-6ee817d2a942 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:41.051377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6abc0a-6cb6-4ad5-8f1f-6ee817d2a942 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:41.052832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 689/1377] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:41.057998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b1fac-9a10-4777-ad79-e597281d9610 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:41.060190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b1fac-9a10-4777-ad79-e597281d9610 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:41.060477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b1fac-9a10-4777-ad79-e597281d9610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:41.133243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-fe8b1fac-9a10-4777-ad79-e597281d9610 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:41.134648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fe8b1fac-9a10-4777-ad79-e597281d9610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:41.239205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 689/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:41.533503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6abc0a-6cb6-4ad5-8f1f-6ee817d2a942 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:41.535154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4f6abc0a-6cb6-4ad5-8f1f-6ee817d2a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:41.575329 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:41.688176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6abc0a-6cb6-4ad5-8f1f-6ee817d2a942 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:41.806618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:41.813235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcda515-0668-4a00-9a2c-6ed58a069f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:41.814067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcda515-0668-4a00-9a2c-6ed58a069f76 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:41.814682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcda515-0668-4a00-9a2c-6ed58a069f76 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:41.814959 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcda515-0668-4a00-9a2c-6ed58a069f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:41.816559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-edcda515-0668-4a00-9a2c-6ed58a069f76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:41.911872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcda515-0668-4a00-9a2c-6ed58a069f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:41.913500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcda515-0668-4a00-9a2c-6ed58a069f76 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:41.932899 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 690/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:44.151903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af134f4-d453-4fa1-a9bb-23ec0cd21aa5 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:44.152352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af134f4-d453-4fa1-a9bb-23ec0cd21aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:44.152636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af134f4-d453-4fa1-a9bb-23ec0cd21aa5 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:44.154014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 690/1380] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:44.159085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a1213-12a8-46e2-9ab7-d6e8c664e4a1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:44.159487 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a1213-12a8-46e2-9ab7-d6e8c664e4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:44.159733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a1213-12a8-46e2-9ab7-d6e8c664e4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:44.235321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ec1a1213-12a8-46e2-9ab7-d6e8c664e4a1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:44.237196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ec1a1213-12a8-46e2-9ab7-d6e8c664e4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:44.320341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:44.359377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 691/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:44.726552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af134f4-d453-4fa1-a9bb-23ec0cd21aa5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:44.728565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7af134f4-d453-4fa1-a9bb-23ec0cd21aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:44.766868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:44.893254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af134f4-d453-4fa1-a9bb-23ec0cd21aa5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:44.989265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:45.005900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234563e-be9c-4efd-b975-266110898e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:45.006535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234563e-be9c-4efd-b975-266110898e4d service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:45.006809 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234563e-be9c-4efd-b975-266110898e4d service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:45.007075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234563e-be9c-4efd-b975-266110898e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:45.008645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1234563e-be9c-4efd-b975-266110898e4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:45.098148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234563e-be9c-4efd-b975-266110898e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:45.099732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234563e-be9c-4efd-b975-266110898e4d service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:45.124650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 691/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:47.311415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1fdcc-2e14-4d45-a7fe-4eb95e03105b None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:47.312083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1fdcc-2e14-4d45-a7fe-4eb95e03105b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:47.312083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1fdcc-2e14-4d45-a7fe-4eb95e03105b None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:47.313177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 692/1383] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:47.319058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01038a14-5f04-41d7-9613-84804ed9ed2c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:47.319500 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01038a14-5f04-41d7-9613-84804ed9ed2c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:47.319848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01038a14-5f04-41d7-9613-84804ed9ed2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:47.389725 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-01038a14-5f04-41d7-9613-84804ed9ed2c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:47.390927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-01038a14-5f04-41d7-9613-84804ed9ed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:47.468863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:47.521178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 692/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:47.811277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1fdcc-2e14-4d45-a7fe-4eb95e03105b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:47.813417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2cc1fdcc-2e14-4d45-a7fe-4eb95e03105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:47.978854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1fdcc-2e14-4d45-a7fe-4eb95e03105b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:48.033106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:48.098905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c797c0b-920e-4de0-9981-f1bcf4653b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:48.099517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c797c0b-920e-4de0-9981-f1bcf4653b90 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:48.099797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c797c0b-920e-4de0-9981-f1bcf4653b90 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:48.100073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c797c0b-920e-4de0-9981-f1bcf4653b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:48.101702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4c797c0b-920e-4de0-9981-f1bcf4653b90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:48.196229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c797c0b-920e-4de0-9981-f1bcf4653b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:48.197852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c797c0b-920e-4de0-9981-f1bcf4653b90 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:48.216348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 693/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:50.369561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc53384-5f5a-4168-9861-002d18d9ebba None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:50.370006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc53384-5f5a-4168-9861-002d18d9ebba None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:50.370134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc53384-5f5a-4168-9861-002d18d9ebba None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:50.371483 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 693/1386] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:50.376801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4366-8ae9-4ef8-8096-57ea04f0a7b3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:50.377239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4366-8ae9-4ef8-8096-57ea04f0a7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:50.377418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb4366-8ae9-4ef8-8096-57ea04f0a7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:50.443678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bbdb4366-8ae9-4ef8-8096-57ea04f0a7b3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:50.444862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bbdb4366-8ae9-4ef8-8096-57ea04f0a7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:50.453914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:50.548794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 694/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:50.835978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc53384-5f5a-4168-9861-002d18d9ebba None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:50.837516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0dc53384-5f5a-4168-9861-002d18d9ebba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:50.979487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc53384-5f5a-4168-9861-002d18d9ebba None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:51.031551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:51.104588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279d285-aed8-4736-904f-6935af436e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:51.105293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279d285-aed8-4736-904f-6935af436e5c service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:51.105575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279d285-aed8-4736-904f-6935af436e5c service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:51.105843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279d285-aed8-4736-904f-6935af436e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:51.108123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3279d285-aed8-4736-904f-6935af436e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:51.207395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279d285-aed8-4736-904f-6935af436e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:51.209206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279d285-aed8-4736-904f-6935af436e5c service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:51.228652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 694/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:52.051995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd09ff-f787-4fe6-9cdc-32152c636f40 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:52.052535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd09ff-f787-4fe6-9cdc-32152c636f40 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:52.052535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd09ff-f787-4fe6-9cdc-32152c636f40 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:52.053920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 695/1389] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:25:52.059392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288926f-8503-49d5-b53f-cd05b1a8c588 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:52.059787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288926f-8503-49d5-b53f-cd05b1a8c588 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:52.059948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288926f-8503-49d5-b53f-cd05b1a8c588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:52.122344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:52.124860 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9288926f-8503-49d5-b53f-cd05b1a8c588 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:52.126101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9288926f-8503-49d5-b53f-cd05b1a8c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:52.225866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 695/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:25:52.521569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a7bfc-9ef1-4d34-9175-43ee03fb0611 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:52.521850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a7bfc-9ef1-4d34-9175-43ee03fb0611 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:52.522121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a7bfc-9ef1-4d34-9175-43ee03fb0611 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:52.523495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 696/1391] 10.222.0.18 () {54 vars in 962 bytes} [Mon Sep 26 10:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:52.528917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6dc37-70b6-4143-a5d2-54e1f3d3f6c5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:52.529239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6dc37-70b6-4143-a5d2-54e1f3d3f6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:52.529517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6dc37-70b6-4143-a5d2-54e1f3d3f6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:52.605587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-19e6dc37-70b6-4143-a5d2-54e1f3d3f6c5 None None] MFA Rules not processed for user `dcfef506919f4914a7883bd99ea07615`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:52.606797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-19e6dc37-70b6-4143-a5d2-54e1f3d3f6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:52.677474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:52.684706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 696/1392] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Sep 26 10:25:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:52.694210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a7bfc-9ef1-4d34-9175-43ee03fb0611 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:52.695729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-df1a7bfc-9ef1-4d34-9175-43ee03fb0611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:52.814250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a7bfc-9ef1-4d34-9175-43ee03fb0611 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:52.850981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:52.887687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c15623-5ccc-489f-805e-a7885bad02dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfef506919f4914a7883bd99ea07615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:52.888299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c15623-5ccc-489f-805e-a7885bad02dc service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:52.888564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c15623-5ccc-489f-805e-a7885bad02dc service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:52.888834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c15623-5ccc-489f-805e-a7885bad02dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:52.890426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-40c15623-5ccc-489f-805e-a7885bad02dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:53.000618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c15623-5ccc-489f-805e-a7885bad02dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:53.002033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c15623-5ccc-489f-805e-a7885bad02dc service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:53.020153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 697/1393] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:53.446666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244887b-2cdb-463b-9e39-acfd1e838b22 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:53.447235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244887b-2cdb-463b-9e39-acfd1e838b22 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:53.447235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244887b-2cdb-463b-9e39-acfd1e838b22 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:53.448556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 697/1394] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:53.454331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f73dd-fab1-48d6-a2c9-12420e07ade9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:53.454731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f73dd-fab1-48d6-a2c9-12420e07ade9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:53.454877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f73dd-fab1-48d6-a2c9-12420e07ade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:53.523395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-208f73dd-fab1-48d6-a2c9-12420e07ade9 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:53.524662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-208f73dd-fab1-48d6-a2c9-12420e07ade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:53.542774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:53.629505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 698/1395] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:53.768356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a5a4-30a8-4fc1-a806-dc5a37fdb21d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:53.768706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a5a4-30a8-4fc1-a806-dc5a37fdb21d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:53.769088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a5a4-30a8-4fc1-a806-dc5a37fdb21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:53.845665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2813a5a4-30a8-4fc1-a806-dc5a37fdb21d None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:53.847237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2813a5a4-30a8-4fc1-a806-dc5a37fdb21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:53.923494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f73dd-fab1-48d6-a2c9-12420e07ade9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:53.924711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-208f73dd-fab1-48d6-a2c9-12420e07ade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:53.953186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 698/1396] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:25:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:53.998970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ed46d-12c3-458b-a5d6-f881764bc555 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:53.999330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ed46d-12c3-458b-a5d6-f881764bc555 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:53.999672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ed46d-12c3-458b-a5d6-f881764bc555 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:54.001536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 699/1397] 10.222.0.18 () {54 vars in 943 bytes} [Mon Sep 26 10:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:25:54.008035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ca8e-5224-4d16-ba28-a7cd589b431b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:54.008467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ca8e-5224-4d16-ba28-a7cd589b431b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:54.008745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ca8e-5224-4d16-ba28-a7cd589b431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:54.055474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f73dd-fab1-48d6-a2c9-12420e07ade9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:54.100631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e7b0ca8e-5224-4d16-ba28-a7cd589b431b None None] MFA Rules not processed for user `e5b380b92dc5438c92380c3fe2406590`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:54.101415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:54.102163 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e7b0ca8e-5224-4d16-ba28-a7cd589b431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:54.133072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:54.189097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09667f-0a01-4c52-b0ec-313d5d823c22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:54.189986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09667f-0a01-4c52-b0ec-313d5d823c22 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:54.190267 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09667f-0a01-4c52-b0ec-313d5d823c22 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:54.190538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09667f-0a01-4c52-b0ec-313d5d823c22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:54.192140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fc09667f-0a01-4c52-b0ec-313d5d823c22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:54.221072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 700/1398] 10.222.0.18 () {58 vars in 1040 bytes} [Mon Sep 26 10:25:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:25:54.231611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ca8e-5224-4d16-ba28-a7cd589b431b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:54.242036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ca8e-5224-4d16-ba28-a7cd589b431b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:54.285220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09667f-0a01-4c52-b0ec-313d5d823c22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:54.286812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09667f-0a01-4c52-b0ec-313d5d823c22 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:54.305386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 699/1399] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:25:54.349017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c666df-6c9e-4d14-b86c-6b1b55f52b7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:54.349624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c666df-6c9e-4d14-b86c-6b1b55f52b7b service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:54.349898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c666df-6c9e-4d14-b86c-6b1b55f52b7b service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:54.350166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c666df-6c9e-4d14-b86c-6b1b55f52b7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:54.351793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-37c666df-6c9e-4d14-b86c-6b1b55f52b7b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:54.387839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:54.447412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c666df-6c9e-4d14-b86c-6b1b55f52b7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:54.448961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c666df-6c9e-4d14-b86c-6b1b55f52b7b service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:54.458065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 701/1400] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 10:25:56.513903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb075a78-f130-4ce8-81eb-bd95deec587c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:56.514428 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb075a78-f130-4ce8-81eb-bd95deec587c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:56.514428 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb075a78-f130-4ce8-81eb-bd95deec587c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:56.515764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 700/1401] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:56.520973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a247-e8d1-45f7-84f1-d24f37877cb0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:56.521396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a247-e8d1-45f7-84f1-d24f37877cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:56.521588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a247-e8d1-45f7-84f1-d24f37877cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:56.596732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8d10a247-e8d1-45f7-84f1-d24f37877cb0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:56.598719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8d10a247-e8d1-45f7-84f1-d24f37877cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:56.714171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 702/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:25:57.011703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb075a78-f130-4ce8-81eb-bd95deec587c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:25:57.013247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fb075a78-f130-4ce8-81eb-bd95deec587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:57.078491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:57.197306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb075a78-f130-4ce8-81eb-bd95deec587c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:25:57.330730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e010f-54e1-48f4-a475-a6be5603a2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:25:57.331631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e010f-54e1-48f4-a475-a6be5603a2b3 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:57.331912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e010f-54e1-48f4-a475-a6be5603a2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:57.332189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e010f-54e1-48f4-a475-a6be5603a2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:57.333836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a34e010f-54e1-48f4-a475-a6be5603a2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:57.336209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:57.442473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e010f-54e1-48f4-a475-a6be5603a2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:25:57.444089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e010f-54e1-48f4-a475-a6be5603a2b3 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:25:57.463269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 701/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:25:59.668479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7cf99-9994-43f7-9060-3ced39ee2d03 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:59.668479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7cf99-9994-43f7-9060-3ced39ee2d03 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:59.668479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7cf99-9994-43f7-9060-3ced39ee2d03 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:59.668479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 703/1404] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:25:59.673822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542b84-c020-4a05-a15d-ca8fa50d9c67 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:25:59.674251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542b84-c020-4a05-a15d-ca8fa50d9c67 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:25:59.674613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542b84-c020-4a05-a15d-ca8fa50d9c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:25:59.746356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-38542b84-c020-4a05-a15d-ca8fa50d9c67 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:25:59.749867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-38542b84-c020-4a05-a15d-ca8fa50d9c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:25:59.828341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:59.856646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 702/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:00.150884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7cf99-9994-43f7-9060-3ced39ee2d03 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:00.152671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e3e7cf99-9994-43f7-9060-3ced39ee2d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:00.183132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:00.322380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7cf99-9994-43f7-9060-3ced39ee2d03 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:00.441297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:00.459639 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5743c7b-b2c7-42cb-b096-e8fa530596cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:00.460485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5743c7b-b2c7-42cb-b096-e8fa530596cf service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:00.460837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5743c7b-b2c7-42cb-b096-e8fa530596cf service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:00.461135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5743c7b-b2c7-42cb-b096-e8fa530596cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:00.462754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a5743c7b-b2c7-42cb-b096-e8fa530596cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:00.562426 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5743c7b-b2c7-42cb-b096-e8fa530596cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:00.564547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5743c7b-b2c7-42cb-b096-e8fa530596cf service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:00.587189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 704/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:02.816533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b0e73-36f3-436b-b900-dbc3a1a25921 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:02.817136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b0e73-36f3-436b-b900-dbc3a1a25921 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:02.817136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b0e73-36f3-436b-b900-dbc3a1a25921 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:02.819190 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 703/1407] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:26:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:02.824660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73d9eb-a222-4bc0-b8ca-5cfa56a8bc39 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:02.825103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73d9eb-a222-4bc0-b8ca-5cfa56a8bc39 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:02.825293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73d9eb-a222-4bc0-b8ca-5cfa56a8bc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:02.894814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1a73d9eb-a222-4bc0-b8ca-5cfa56a8bc39 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:02.896152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1a73d9eb-a222-4bc0-b8ca-5cfa56a8bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:02.955769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:03.001789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 705/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:03.291769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b0e73-36f3-436b-b900-dbc3a1a25921 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:03.293603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2d3b0e73-36f3-436b-b900-dbc3a1a25921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:03.469552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b0e73-36f3-436b-b900-dbc3a1a25921 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:03.534614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:03.596793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44c5c-fc8d-41ac-ac4c-e78f1ad74b1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:03.597753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44c5c-fc8d-41ac-ac4c-e78f1ad74b1a service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:03.598030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44c5c-fc8d-41ac-ac4c-e78f1ad74b1a service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:03.598303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44c5c-fc8d-41ac-ac4c-e78f1ad74b1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:03.600008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d6b44c5c-fc8d-41ac-ac4c-e78f1ad74b1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:03.702778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44c5c-fc8d-41ac-ac4c-e78f1ad74b1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:03.704516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44c5c-fc8d-41ac-ac4c-e78f1ad74b1a service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:03.724731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 704/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:12.997382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=16 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:13.722107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=71 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:16.917221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9de50-72d9-4aa7-bd34-309fde5234f7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:16.917779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9de50-72d9-4aa7-bd34-309fde5234f7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:16.917779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9de50-72d9-4aa7-bd34-309fde5234f7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:16.919613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 706/1410] 10.222.0.18 () {54 vars in 918 bytes} [Mon Sep 26 10:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:16.924529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486ddd2-f771-4aae-8bd0-c6e5d9edbff7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:16.924923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486ddd2-f771-4aae-8bd0-c6e5d9edbff7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:16.925124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486ddd2-f771-4aae-8bd0-c6e5d9edbff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:16.999192 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d486ddd2-f771-4aae-8bd0-c6e5d9edbff7 None None] MFA Rules not processed for user `794990333d3748abad7683590b0e5d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:17.000382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d486ddd2-f771-4aae-8bd0-c6e5d9edbff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:17.103109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 705/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Sep 26 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:17.117763 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc04017-cff2-4888-8675-9bb3eff8950d None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:17.118044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc04017-cff2-4888-8675-9bb3eff8950d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:17.118315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc04017-cff2-4888-8675-9bb3eff8950d None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:17.119717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 707/1412] 10.222.0.18 () {54 vars in 918 bytes} [Mon Sep 26 10:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:17.124412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96199f-d484-438f-827e-bfada8300f0b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:17.124693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96199f-d484-438f-827e-bfada8300f0b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:17.124995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96199f-d484-438f-827e-bfada8300f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:17.195134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:17.198454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-af96199f-d484-438f-827e-bfada8300f0b None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:17.200237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-af96199f-d484-438f-827e-bfada8300f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:17.314475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 706/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Sep 26 10:26:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:19.863600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31b51-4a88-4d95-b28a-c273d888581b None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:19.864125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31b51-4a88-4d95-b28a-c273d888581b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:19.864125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c31b51-4a88-4d95-b28a-c273d888581b None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:19.865498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:19.870675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfcdad-a4d4-417b-ab2f-67a0adeea035 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:19.871120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfcdad-a4d4-417b-ab2f-67a0adeea035 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:19.871228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfcdad-a4d4-417b-ab2f-67a0adeea035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:19.936219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d1bfcdad-a4d4-417b-ab2f-67a0adeea035 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:19.937455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d1bfcdad-a4d4-417b-ab2f-67a0adeea035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:19.993303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:20.035381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:20.325845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c31b51-4a88-4d95-b28a-c273d888581b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:20.327628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c4c31b51-4a88-4d95-b28a-c273d888581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:20.473271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c31b51-4a88-4d95-b28a-c273d888581b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:20.544358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:20.583751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab37da3-19e3-4f7f-853b-052bf108d6d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:20.584344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab37da3-19e3-4f7f-853b-052bf108d6d1 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:20.584624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab37da3-19e3-4f7f-853b-052bf108d6d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:20.584886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab37da3-19e3-4f7f-853b-052bf108d6d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:20.586480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2ab37da3-19e3-4f7f-853b-052bf108d6d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:20.673629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab37da3-19e3-4f7f-853b-052bf108d6d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:20.675205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab37da3-19e3-4f7f-853b-052bf108d6d1 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:20.693394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 709/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:21.833792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b902d-4de8-4d0f-9c37-e49550cad386 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:21.834345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b902d-4de8-4d0f-9c37-e49550cad386 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:21.834345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b902d-4de8-4d0f-9c37-e49550cad386 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:21.835672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:21.842608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ddc64-3864-4e2f-8612-30cf048266c1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:21.843039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ddc64-3864-4e2f-8612-30cf048266c1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:21.843146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ddc64-3864-4e2f-8612-30cf048266c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:21.916496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-759ddc64-3864-4e2f-8612-30cf048266c1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:21.917723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-759ddc64-3864-4e2f-8612-30cf048266c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:21.944509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:22.013412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:22.163762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b902d-4de8-4d0f-9c37-e49550cad386 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:22.165223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ee7b902d-4de8-4d0f-9c37-e49550cad386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:22.309183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b902d-4de8-4d0f-9c37-e49550cad386 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:22.349438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:22.422552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7e7ec-0e19-4898-8155-fdd596936717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:22.423102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e7ec-0e19-4898-8155-fdd596936717 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:22.423380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e7ec-0e19-4898-8155-fdd596936717 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:22.423652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e7ec-0e19-4898-8155-fdd596936717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:22.425269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0fa7e7ec-0e19-4898-8155-fdd596936717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:22.514556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7e7ec-0e19-4898-8155-fdd596936717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:22.516145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7e7ec-0e19-4898-8155-fdd596936717 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:22.534162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 709/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:23.647407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c083f-17e0-4464-ab87-19f75a60b8b4 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:23.647965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c083f-17e0-4464-ab87-19f75a60b8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:23.647965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c083f-17e0-4464-ab87-19f75a60b8b4 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:23.649227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:23.655884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62053-e45d-4313-9607-d577a495e4e1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:23.656345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62053-e45d-4313-9607-d577a495e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:23.656448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62053-e45d-4313-9607-d577a495e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:23.710711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:23.733801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d6b62053-e45d-4313-9607-d577a495e4e1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:23.735029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d6b62053-e45d-4313-9607-d577a495e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:23.829167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:23.979468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c083f-17e0-4464-ab87-19f75a60b8b4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:23.980901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ab0c083f-17e0-4464-ab87-19f75a60b8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:24.125168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c083f-17e0-4464-ab87-19f75a60b8b4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:24.137031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:24.235727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfcf74-7788-4956-ae5a-e9316057b2b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:24.236249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfcf74-7788-4956-ae5a-e9316057b2b2 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:24.236526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfcf74-7788-4956-ae5a-e9316057b2b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:24.236796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfcf74-7788-4956-ae5a-e9316057b2b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:24.238384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-95cfcf74-7788-4956-ae5a-e9316057b2b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:24.323900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfcf74-7788-4956-ae5a-e9316057b2b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:24.325988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfcf74-7788-4956-ae5a-e9316057b2b2 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:24.343210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 712/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:25.444327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161602-c52d-4afc-9aa1-a806e2fa379c None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:25.444863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161602-c52d-4afc-9aa1-a806e2fa379c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:25.444863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161602-c52d-4afc-9aa1-a806e2fa379c None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:25.446250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:25.452893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2060f-5382-47e9-ab75-a4ce01a1b935 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:25.453368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2060f-5382-47e9-ab75-a4ce01a1b935 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:25.453472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2060f-5382-47e9-ab75-a4ce01a1b935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:25.473676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:25.529491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c6f2060f-5382-47e9-ab75-a4ce01a1b935 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:25.530696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c6f2060f-5382-47e9-ab75-a4ce01a1b935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:25.624337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:25.774631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0161602-c52d-4afc-9aa1-a806e2fa379c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:25.776117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a0161602-c52d-4afc-9aa1-a806e2fa379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:25.882613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:25.919274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0161602-c52d-4afc-9aa1-a806e2fa379c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:26.030582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7300e-ec73-4a6c-a8de-4f810f525fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:26.031188 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7300e-ec73-4a6c-a8de-4f810f525fdd service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:26.031470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7300e-ec73-4a6c-a8de-4f810f525fdd service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:26.031741 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7300e-ec73-4a6c-a8de-4f810f525fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:26.033372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d2c7300e-ec73-4a6c-a8de-4f810f525fdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:26.112143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:26.126325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7300e-ec73-4a6c-a8de-4f810f525fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:26.127917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7300e-ec73-4a6c-a8de-4f810f525fdd service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:26.146361 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 712/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:27.247108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc466bf-6d38-4ddc-8ca8-5f1aab16488f None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:27.247691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc466bf-6d38-4ddc-8ca8-5f1aab16488f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:27.247691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc466bf-6d38-4ddc-8ca8-5f1aab16488f None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:27.249001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:27.255281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39a5d-b144-4b6e-8dae-b9145a58352d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:27.255757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39a5d-b144-4b6e-8dae-b9145a58352d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:27.255865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39a5d-b144-4b6e-8dae-b9145a58352d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:27.330611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-24c39a5d-b144-4b6e-8dae-b9145a58352d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:27.331818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-24c39a5d-b144-4b6e-8dae-b9145a58352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:27.427688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:27.578136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc466bf-6d38-4ddc-8ca8-5f1aab16488f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:27.579621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9cc466bf-6d38-4ddc-8ca8-5f1aab16488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:27.665907 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:27.726512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc466bf-6d38-4ddc-8ca8-5f1aab16488f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:27.835935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c0fe8-8a6b-4372-ac0d-b9b119e7acef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:27.836454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0fe8-8a6b-4372-ac0d-b9b119e7acef service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:27.836731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0fe8-8a6b-4372-ac0d-b9b119e7acef service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:27.837032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0fe8-8a6b-4372-ac0d-b9b119e7acef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:27.838607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d72c0fe8-8a6b-4372-ac0d-b9b119e7acef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:27.885663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:27.926458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c0fe8-8a6b-4372-ac0d-b9b119e7acef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:27.928026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c0fe8-8a6b-4372-ac0d-b9b119e7acef service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:27.945961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 715/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:29.003546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec8ef1-7a56-4385-ad24-5f3d931d7b98 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:29.004112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec8ef1-7a56-4385-ad24-5f3d931d7b98 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:29.004112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec8ef1-7a56-4385-ad24-5f3d931d7b98 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:29.005376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:29.011391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c617ab-3155-4e1c-95d6-a1e46bd5e06c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:29.011836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c617ab-3155-4e1c-95d6-a1e46bd5e06c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:29.011956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c617ab-3155-4e1c-95d6-a1e46bd5e06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:29.087968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-63c617ab-3155-4e1c-95d6-a1e46bd5e06c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:29.089228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-63c617ab-3155-4e1c-95d6-a1e46bd5e06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:29.183459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:29.333480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec8ef1-7a56-4385-ad24-5f3d931d7b98 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:29.335013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ebec8ef1-7a56-4385-ad24-5f3d931d7b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:29.383876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:29.482725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec8ef1-7a56-4385-ad24-5f3d931d7b98 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:29.594347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3c3a3-9e57-445f-a0c6-a54c6a0215a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:29.594953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3c3a3-9e57-445f-a0c6-a54c6a0215a3 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:29.595228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3c3a3-9e57-445f-a0c6-a54c6a0215a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:29.595495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3c3a3-9e57-445f-a0c6-a54c6a0215a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:29.597108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e5a3c3a3-9e57-445f-a0c6-a54c6a0215a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:29.603794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:29.711809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3c3a3-9e57-445f-a0c6-a54c6a0215a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:29.713479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3c3a3-9e57-445f-a0c6-a54c6a0215a3 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:29.734555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 715/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:30.781606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e4582-9d98-4199-a985-5dfdec6f5d7b None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:30.782056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e4582-9d98-4199-a985-5dfdec6f5d7b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:30.782298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e4582-9d98-4199-a985-5dfdec6f5d7b None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:30.783507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:30.789975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb13e-3487-4916-8f76-bcd56e48ccc0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:30.790411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb13e-3487-4916-8f76-bcd56e48ccc0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:30.790514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb13e-3487-4916-8f76-bcd56e48ccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:30.866476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-93edb13e-3487-4916-8f76-bcd56e48ccc0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:30.867690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-93edb13e-3487-4916-8f76-bcd56e48ccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:30.934653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:30.966769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:31.120882 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e4582-9d98-4199-a985-5dfdec6f5d7b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:31.123121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2c1e4582-9d98-4199-a985-5dfdec6f5d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:31.140816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:31.269873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e4582-9d98-4199-a985-5dfdec6f5d7b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:31.357633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:31.385260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623d552-c4c5-4370-a52c-b210a02b5a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:31.385796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623d552-c4c5-4370-a52c-b210a02b5a5b service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:31.386101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623d552-c4c5-4370-a52c-b210a02b5a5b service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:31.386369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623d552-c4c5-4370-a52c-b210a02b5a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:31.388572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6623d552-c4c5-4370-a52c-b210a02b5a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:31.476536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623d552-c4c5-4370-a52c-b210a02b5a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:31.478370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623d552-c4c5-4370-a52c-b210a02b5a5b service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:31.496009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 718/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:32.565531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8e409-0d5f-4661-a384-daad7c34b064 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:32.566065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8e409-0d5f-4661-a384-daad7c34b064 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:32.566065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8e409-0d5f-4661-a384-daad7c34b064 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:32.567417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:32.573660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a4ac0-6fa5-409e-bc0d-125006a67dd6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:32.574069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a4ac0-6fa5-409e-bc0d-125006a67dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:32.574217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a4ac0-6fa5-409e-bc0d-125006a67dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:32.649048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-674a4ac0-6fa5-409e-bc0d-125006a67dd6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:32.650282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-674a4ac0-6fa5-409e-bc0d-125006a67dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:32.691160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:32.745159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:32.895612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8e409-0d5f-4661-a384-daad7c34b064 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:32.897095 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2de8e409-0d5f-4661-a384-daad7c34b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:33.039207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8e409-0d5f-4661-a384-daad7c34b064 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:33.092612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:33.150895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea7e2e-76ac-418f-9f2f-aa3b0ac66d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:33.151423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea7e2e-76ac-418f-9f2f-aa3b0ac66d87 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:33.151703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea7e2e-76ac-418f-9f2f-aa3b0ac66d87 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:33.151974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea7e2e-76ac-418f-9f2f-aa3b0ac66d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:33.153612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-63ea7e2e-76ac-418f-9f2f-aa3b0ac66d87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:33.242168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea7e2e-76ac-418f-9f2f-aa3b0ac66d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:33.243756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea7e2e-76ac-418f-9f2f-aa3b0ac66d87 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:33.262085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 718/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:34.299901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05800-940c-47e0-97cd-80d97726b565 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:34.300463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05800-940c-47e0-97cd-80d97726b565 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:34.300463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a05800-940c-47e0-97cd-80d97726b565 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:34.301803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:34.308168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038f84-b05d-48e5-9488-328eeb7ef302 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:34.308601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038f84-b05d-48e5-9488-328eeb7ef302 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:34.308749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038f84-b05d-48e5-9488-328eeb7ef302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:34.384671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-39038f84-b05d-48e5-9488-328eeb7ef302 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:34.385917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-39038f84-b05d-48e5-9488-328eeb7ef302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:34.387939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:34.482864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:34.629538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a05800-940c-47e0-97cd-80d97726b565 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:34.631098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-24a05800-940c-47e0-97cd-80d97726b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:34.773071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a05800-940c-47e0-97cd-80d97726b565 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:34.800650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:34.884649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76adb-a9a3-4b75-920d-8f5b998a453e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:34.885204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76adb-a9a3-4b75-920d-8f5b998a453e service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:34.885484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76adb-a9a3-4b75-920d-8f5b998a453e service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:34.885755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76adb-a9a3-4b75-920d-8f5b998a453e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:34.887317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2cb76adb-a9a3-4b75-920d-8f5b998a453e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:34.975173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76adb-a9a3-4b75-920d-8f5b998a453e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:34.976743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76adb-a9a3-4b75-920d-8f5b998a453e service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:34.994401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 721/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:37.028732 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb72b5-0d13-4b14-af24-ec905ed42af3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:37.029377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb72b5-0d13-4b14-af24-ec905ed42af3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:37.029377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb72b5-0d13-4b14-af24-ec905ed42af3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:37.030849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:37.036460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c0ac0-f740-4d7f-a130-07a9e7557954 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:37.036875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c0ac0-f740-4d7f-a130-07a9e7557954 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:37.036999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c0ac0-f740-4d7f-a130-07a9e7557954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:37.080623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:37.105242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-937c0ac0-f740-4d7f-a130-07a9e7557954 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:37.106987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-937c0ac0-f740-4d7f-a130-07a9e7557954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:37.201638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:37.483702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb72b5-0d13-4b14-af24-ec905ed42af3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:37.485266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1cdb72b5-0d13-4b14-af24-ec905ed42af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:37.587799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb72b5-0d13-4b14-af24-ec905ed42af3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:37.618706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:37.661066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ec4de-11ef-43f7-95ef-f8157cdf30bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:37.661672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ec4de-11ef-43f7-95ef-f8157cdf30bb service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:37.661951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ec4de-11ef-43f7-95ef-f8157cdf30bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:37.662223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ec4de-11ef-43f7-95ef-f8157cdf30bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:37.663791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-258ec4de-11ef-43f7-95ef-f8157cdf30bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:37.769867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ec4de-11ef-43f7-95ef-f8157cdf30bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:37.771309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ec4de-11ef-43f7-95ef-f8157cdf30bb service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:37.789129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 721/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:40.239370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04a6e4-1f85-4cba-8995-9670104643c7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:40.239911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04a6e4-1f85-4cba-8995-9670104643c7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:40.239911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04a6e4-1f85-4cba-8995-9670104643c7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:40.241311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:40.246557 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127dee3-2d51-415a-9d13-2b925a98f9c1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:40.247020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127dee3-2d51-415a-9d13-2b925a98f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:40.247139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127dee3-2d51-415a-9d13-2b925a98f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:40.311533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8127dee3-2d51-415a-9d13-2b925a98f9c1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:40.312718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8127dee3-2d51-415a-9d13-2b925a98f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:40.328940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:40.412960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:40.699487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04a6e4-1f85-4cba-8995-9670104643c7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:40.701703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fd04a6e4-1f85-4cba-8995-9670104643c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:40.802378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04a6e4-1f85-4cba-8995-9670104643c7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:40.815397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:40.875305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6c0dc-cc42-4d5d-b3f8-f22797f8e0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:40.875898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6c0dc-cc42-4d5d-b3f8-f22797f8e0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:40.876172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6c0dc-cc42-4d5d-b3f8-f22797f8e0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:40.876435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6c0dc-cc42-4d5d-b3f8-f22797f8e0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:40.878014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0be6c0dc-cc42-4d5d-b3f8-f22797f8e0a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:40.983563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6c0dc-cc42-4d5d-b3f8-f22797f8e0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:40.983563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6c0dc-cc42-4d5d-b3f8-f22797f8e0a4 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:41.001424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 724/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:43.441794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449d09-9024-4a94-9869-3e7ff11cb34f None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:43.442312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449d09-9024-4a94-9869-3e7ff11cb34f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:43.442406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449d09-9024-4a94-9869-3e7ff11cb34f None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:43.443712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:43.448856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886aaa5-f88a-4271-b824-57a905722040 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:43.449269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886aaa5-f88a-4271-b824-57a905722040 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:43.449439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886aaa5-f88a-4271-b824-57a905722040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:43.498251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:43.516803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-5886aaa5-f88a-4271-b824-57a905722040 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:43.518037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5886aaa5-f88a-4271-b824-57a905722040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:43.616856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:43.930685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449d09-9024-4a94-9869-3e7ff11cb34f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:43.932249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-06449d09-9024-4a94-9869-3e7ff11cb34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:44.037029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449d09-9024-4a94-9869-3e7ff11cb34f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:44.076854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:44.110552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7d3b8-af29-4ccd-9e65-1df08f1456df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:44.111157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7d3b8-af29-4ccd-9e65-1df08f1456df service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:44.111435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7d3b8-af29-4ccd-9e65-1df08f1456df service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:44.111725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7d3b8-af29-4ccd-9e65-1df08f1456df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:44.113319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a6a7d3b8-af29-4ccd-9e65-1df08f1456df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:44.220587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7d3b8-af29-4ccd-9e65-1df08f1456df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:44.221981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7d3b8-af29-4ccd-9e65-1df08f1456df service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:44.239387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 724/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:46.485354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c8c97-71b7-4545-8cc0-1abd496b2b85 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:46.485883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c8c97-71b7-4545-8cc0-1abd496b2b85 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:46.485999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c8c97-71b7-4545-8cc0-1abd496b2b85 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:46.487289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:46.492618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be044ca7-93dd-41d0-a7ca-8c382d9cfa59 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:46.493433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be044ca7-93dd-41d0-a7ca-8c382d9cfa59 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:46.493711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be044ca7-93dd-41d0-a7ca-8c382d9cfa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:46.558956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-be044ca7-93dd-41d0-a7ca-8c382d9cfa59 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:46.560692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-be044ca7-93dd-41d0-a7ca-8c382d9cfa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:46.581282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:46.655587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:46.941975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c8c97-71b7-4545-8cc0-1abd496b2b85 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:46.943486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-119c8c97-71b7-4545-8cc0-1abd496b2b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:47.049458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c8c97-71b7-4545-8cc0-1abd496b2b85 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:47.068332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:47.123333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017a6f-5e9a-43a6-8cb5-423e07550a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:47.123932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017a6f-5e9a-43a6-8cb5-423e07550a3d service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:47.124209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017a6f-5e9a-43a6-8cb5-423e07550a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:47.124475 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017a6f-5e9a-43a6-8cb5-423e07550a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:47.126076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f4017a6f-5e9a-43a6-8cb5-423e07550a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:47.233260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017a6f-5e9a-43a6-8cb5-423e07550a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:47.234596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017a6f-5e9a-43a6-8cb5-423e07550a3d service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:47.252532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 727/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:49.501507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc09ae-d88f-4584-9a69-e0a43c867acb None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:49.502040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc09ae-d88f-4584-9a69-e0a43c867acb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:49.502040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc09ae-d88f-4584-9a69-e0a43c867acb None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:49.503390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:49.508773 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe350c5-d4d0-441c-9f05-2fe9ff967638 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:49.509249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe350c5-d4d0-441c-9f05-2fe9ff967638 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:49.509405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe350c5-d4d0-441c-9f05-2fe9ff967638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:49.571885 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:49.574968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-afe350c5-d4d0-441c-9f05-2fe9ff967638 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:49.576749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-afe350c5-d4d0-441c-9f05-2fe9ff967638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:49.672427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:49.953660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc09ae-d88f-4584-9a69-e0a43c867acb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:49.955225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4ecc09ae-d88f-4584-9a69-e0a43c867acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:50.057568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc09ae-d88f-4584-9a69-e0a43c867acb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:50.108975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:50.133799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6be4c-32af-4515-a270-a4c36878cfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:50.134399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6be4c-32af-4515-a270-a4c36878cfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:50.134677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6be4c-32af-4515-a270-a4c36878cfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:50.134948 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6be4c-32af-4515-a270-a4c36878cfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:50.136529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9ce6be4c-32af-4515-a270-a4c36878cfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:50.242350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6be4c-32af-4515-a270-a4c36878cfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:50.243695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6be4c-32af-4515-a270-a4c36878cfd7 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:50.261969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 727/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:52.441790 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402fa3-e38a-4002-bb29-15c0ba3e9758 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:52.442316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402fa3-e38a-4002-bb29-15c0ba3e9758 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:52.442316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402fa3-e38a-4002-bb29-15c0ba3e9758 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:52.443655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:52.448987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c0e30-f3c7-4aef-bb8d-ccc395f30a32 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:52.449368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c0e30-f3c7-4aef-bb8d-ccc395f30a32 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:52.449542 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c0e30-f3c7-4aef-bb8d-ccc395f30a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:52.515557 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ea6c0e30-f3c7-4aef-bb8d-ccc395f30a32 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:52.516743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ea6c0e30-f3c7-4aef-bb8d-ccc395f30a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:52.544249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:52.610873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:52.890187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20402fa3-e38a-4002-bb29-15c0ba3e9758 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:52.891748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-20402fa3-e38a-4002-bb29-15c0ba3e9758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:52.992911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20402fa3-e38a-4002-bb29-15c0ba3e9758 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:53.022658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:53.068164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797c535-8a0f-45b3-b60f-13ba77a4d075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:53.068698 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c535-8a0f-45b3-b60f-13ba77a4d075 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:53.069006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c535-8a0f-45b3-b60f-13ba77a4d075 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:53.069283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c535-8a0f-45b3-b60f-13ba77a4d075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:53.070871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4797c535-8a0f-45b3-b60f-13ba77a4d075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:53.177616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797c535-8a0f-45b3-b60f-13ba77a4d075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:53.179036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797c535-8a0f-45b3-b60f-13ba77a4d075 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:53.196712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 730/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:55.427506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35c862-dc96-475f-b0d4-b37fce4a8635 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:55.428069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35c862-dc96-475f-b0d4-b37fce4a8635 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:55.428069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35c862-dc96-475f-b0d4-b37fce4a8635 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:55.429433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:55.434653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c2f8-31ea-4fa9-beab-c4d006255bb1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:55.435592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c2f8-31ea-4fa9-beab-c4d006255bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:55.435782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c2f8-31ea-4fa9-beab-c4d006255bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:55.499587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7aa2c2f8-31ea-4fa9-beab-c4d006255bb1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:55.500779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7aa2c2f8-31ea-4fa9-beab-c4d006255bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:55.509204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:55.595180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:55.885636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35c862-dc96-475f-b0d4-b37fce4a8635 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:55.887199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fb35c862-dc96-475f-b0d4-b37fce4a8635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:55.988702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35c862-dc96-475f-b0d4-b37fce4a8635 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:56.045235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:56.065972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5986dcd-b049-4574-95c9-1528584edb84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:56.066582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5986dcd-b049-4574-95c9-1528584edb84 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:56.066861 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5986dcd-b049-4574-95c9-1528584edb84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:56.067131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5986dcd-b049-4574-95c9-1528584edb84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:56.068751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a5986dcd-b049-4574-95c9-1528584edb84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:56.176332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5986dcd-b049-4574-95c9-1528584edb84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:56.177776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5986dcd-b049-4574-95c9-1528584edb84 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:56.195995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 730/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:58.460735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad89fc-f6dd-43fb-9489-a1131567b351 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:58.461311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad89fc-f6dd-43fb-9489-a1131567b351 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:58.461654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad89fc-f6dd-43fb-9489-a1131567b351 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:58.463761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:26:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:26:58.469433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc75f0-74c8-4c54-9421-e8a33291b5d2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:58.469857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc75f0-74c8-4c54-9421-e8a33291b5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:58.469974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc75f0-74c8-4c54-9421-e8a33291b5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:58.533754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bbfc75f0-74c8-4c54-9421-e8a33291b5d2 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:26:58.534943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bbfc75f0-74c8-4c54-9421-e8a33291b5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:58.572458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:58.632892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:26:58.923470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad89fc-f6dd-43fb-9489-a1131567b351 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:26:58.925004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b0ad89fc-f6dd-43fb-9489-a1131567b351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:59.026260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad89fc-f6dd-43fb-9489-a1131567b351 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:26:59.063831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:59.100351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30639c-8c7d-4e38-81e8-64b26f227654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:26:59.100977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30639c-8c7d-4e38-81e8-64b26f227654 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:26:59.101260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30639c-8c7d-4e38-81e8-64b26f227654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:26:59.101528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30639c-8c7d-4e38-81e8-64b26f227654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:26:59.103127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0a30639c-8c7d-4e38-81e8-64b26f227654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:26:59.211023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30639c-8c7d-4e38-81e8-64b26f227654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:26:59.212361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30639c-8c7d-4e38-81e8-64b26f227654 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:26:59.230489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 733/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:27:01.546775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bc569-7a60-4429-8490-75aadf02c7bc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:01.547309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bc569-7a60-4429-8490-75aadf02c7bc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:01.547309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bc569-7a60-4429-8490-75aadf02c7bc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:01.548550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:27:01.554055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac638429-8cac-4577-abc0-9842de53d90e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:01.554459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac638429-8cac-4577-abc0-9842de53d90e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:01.554604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac638429-8cac-4577-abc0-9842de53d90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:01.619124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ac638429-8cac-4577-abc0-9842de53d90e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:27:01.620324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ac638429-8cac-4577-abc0-9842de53d90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:01.638974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:01.715853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:27:01.998633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bc569-7a60-4429-8490-75aadf02c7bc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:27:02.000191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7b0bc569-7a60-4429-8490-75aadf02c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:02.101948 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bc569-7a60-4429-8490-75aadf02c7bc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:27:02.169082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:02.177144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a18d0c-6915-4495-b2de-51dc11ee20fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:27:02.177754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a18d0c-6915-4495-b2de-51dc11ee20fa service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:02.178031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a18d0c-6915-4495-b2de-51dc11ee20fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:02.178302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a18d0c-6915-4495-b2de-51dc11ee20fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:02.179881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-27a18d0c-6915-4495-b2de-51dc11ee20fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:02.290883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a18d0c-6915-4495-b2de-51dc11ee20fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:27:02.292228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a18d0c-6915-4495-b2de-51dc11ee20fa service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:27:02.312555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 733/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:27:04.469202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e11c6-3324-4d52-b9cd-f0b526ec106f None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:04.469733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e11c6-3324-4d52-b9cd-f0b526ec106f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:04.469733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e11c6-3324-4d52-b9cd-f0b526ec106f None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:04.471094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:27:04.476461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d7cb4-c8e9-4b94-a1cd-8153a1fc4264 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:04.476885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d7cb4-c8e9-4b94-a1cd-8153a1fc4264 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:04.477082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d7cb4-c8e9-4b94-a1cd-8153a1fc4264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:04.542065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5d1d7cb4-c8e9-4b94-a1cd-8153a1fc4264 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:27:04.543259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d1d7cb4-c8e9-4b94-a1cd-8153a1fc4264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:04.590476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:04.637463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:27:04.915724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e11c6-3324-4d52-b9cd-f0b526ec106f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:27:04.917323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2e6e11c6-3324-4d52-b9cd-f0b526ec106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:05.019169 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e11c6-3324-4d52-b9cd-f0b526ec106f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:27:05.067524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:05.093913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14da4f-ba67-4a04-8210-572f7e72af26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:27:05.094513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14da4f-ba67-4a04-8210-572f7e72af26 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:05.094788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14da4f-ba67-4a04-8210-572f7e72af26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:05.095056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14da4f-ba67-4a04-8210-572f7e72af26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:05.096606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-df14da4f-ba67-4a04-8210-572f7e72af26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:05.207440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14da4f-ba67-4a04-8210-572f7e72af26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:27:05.208775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14da4f-ba67-4a04-8210-572f7e72af26 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:27:05.226214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 736/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:27:14.635979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=22 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:15.223918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=66 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:25.028786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b54a-b8d2-4084-b1fe-78a94dc98064 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:25.029334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b54a-b8d2-4084-b1fe-78a94dc98064 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:25.029448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b54a-b8d2-4084-b1fe-78a94dc98064 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:25.030711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 735/1471] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:27:25.035982 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee9738-645e-460b-90a2-42ac06437403 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:25.036376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee9738-645e-460b-90a2-42ac06437403 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:25.036537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee9738-645e-460b-90a2-42ac06437403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:25.102719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e0ee9738-645e-460b-90a2-42ac06437403 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:27:25.104033 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e0ee9738-645e-460b-90a2-42ac06437403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:25.198180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 737/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:27:25.495409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1db9-086c-439d-bd65-0099c709aa19 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:25.495696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1db9-086c-439d-bd65-0099c709aa19 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:25.495973 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1db9-086c-439d-bd65-0099c709aa19 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:25.497335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 736/1473] 10.222.0.18 () {54 vars in 962 bytes} [Mon Sep 26 10:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:27:25.502820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b9bda-0349-46d0-bfb2-18b23b251199 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:25.503108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b9bda-0349-46d0-bfb2-18b23b251199 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:25.503410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b9bda-0349-46d0-bfb2-18b23b251199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:25.578144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-288b9bda-0349-46d0-bfb2-18b23b251199 None None] MFA Rules not processed for user `dcfef506919f4914a7883bd99ea07615`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:27:25.579342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-288b9bda-0349-46d0-bfb2-18b23b251199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:25.599384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:25.654775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 738/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Sep 26 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:27:25.662273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc1db9-086c-439d-bd65-0099c709aa19 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:27:25.663760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8cfc1db9-086c-439d-bd65-0099c709aa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:25.766565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc1db9-086c-439d-bd65-0099c709aa19 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:27:25.839154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a02c86-086f-42a2-9bf3-91cbd06618e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfef506919f4914a7883bd99ea07615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:27:25.839752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a02c86-086f-42a2-9bf3-91cbd06618e0 service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:25.840029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a02c86-086f-42a2-9bf3-91cbd06618e0 service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:25.840301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a02c86-086f-42a2-9bf3-91cbd06618e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:25.842515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d5a02c86-086f-42a2-9bf3-91cbd06618e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:25.895253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:25.950301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a02c86-086f-42a2-9bf3-91cbd06618e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:27:25.952182 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a02c86-086f-42a2-9bf3-91cbd06618e0 service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:27:26.086578 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 737/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:27:28.327482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b0cf-a2c2-4200-9679-fb0ce9b80cf8 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:28.328021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b0cf-a2c2-4200-9679-fb0ce9b80cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:28.328021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b0cf-a2c2-4200-9679-fb0ce9b80cf8 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:28.329418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 739/1476] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:27:28.334618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d2184-63d0-4ea5-9619-c0af590c16ec None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:28.335058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d2184-63d0-4ea5-9619-c0af590c16ec None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:28.335218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d2184-63d0-4ea5-9619-c0af590c16ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:28.399930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b51d2184-63d0-4ea5-9619-c0af590c16ec None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:27:28.401152 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b51d2184-63d0-4ea5-9619-c0af590c16ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:28.495574 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 738/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:27:28.768880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3b0cf-a2c2-4200-9679-fb0ce9b80cf8 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:27:28.770434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-26d3b0cf-a2c2-4200-9679-fb0ce9b80cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:28.892923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3b0cf-a2c2-4200-9679-fb0ce9b80cf8 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:27:28.941144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:28.984799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb6b22-70f4-4d7f-a92c-efc42a6350e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:27:28.985425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb6b22-70f4-4d7f-a92c-efc42a6350e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:28.985705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb6b22-70f4-4d7f-a92c-efc42a6350e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:28.985975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb6b22-70f4-4d7f-a92c-efc42a6350e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:28.986605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb6b22-70f4-4d7f-a92c-efc42a6350e6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:27:28.988305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-8cdb6b22-70f4-4d7f-a92c-efc42a6350e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:27:28.988305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: warnings.warn(msg) Sep 26 10:27:28.988305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: Sep 26 10:27:28.989480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb6b22-70f4-4d7f-a92c-efc42a6350e6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:27:29.007950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 740/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 10:27:28 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:27:31.156739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c24062-0473-4b79-9f29-0916e49957b1 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:31.157328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c24062-0473-4b79-9f29-0916e49957b1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:31.157328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c24062-0473-4b79-9f29-0916e49957b1 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:31.158648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 739/1479] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:27:31.163880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0745df3-f605-45c9-8cad-b6e06340352b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:31.164344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0745df3-f605-45c9-8cad-b6e06340352b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:31.164446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0745df3-f605-45c9-8cad-b6e06340352b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:31.230167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b0745df3-f605-45c9-8cad-b6e06340352b None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:27:31.231370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b0745df3-f605-45c9-8cad-b6e06340352b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:31.326926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 741/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:27:31.618054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c24062-0473-4b79-9f29-0916e49957b1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:27:31.619555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-44c24062-0473-4b79-9f29-0916e49957b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:31.630041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:31.762533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c24062-0473-4b79-9f29-0916e49957b1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:27:31.842849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:31.876560 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8973d8-9c4f-4e00-8a64-43dfab81cca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:27:31.877118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8973d8-9c4f-4e00-8a64-43dfab81cca4 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:31.877397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8973d8-9c4f-4e00-8a64-43dfab81cca4 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:31.877667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8973d8-9c4f-4e00-8a64-43dfab81cca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:31.879236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fc8973d8-9c4f-4e00-8a64-43dfab81cca4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:31.965561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8973d8-9c4f-4e00-8a64-43dfab81cca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:27:31.967131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8973d8-9c4f-4e00-8a64-43dfab81cca4 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:27:31.984811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 740/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:27:34.302252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2e5ee-c1bb-43fc-a078-85dbd87fb704 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:34.302877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2e5ee-c1bb-43fc-a078-85dbd87fb704 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:34.302877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2e5ee-c1bb-43fc-a078-85dbd87fb704 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:34.304191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 742/1482] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:27:34.309373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d431-b241-4ede-a334-3120446a47ee None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:34.309799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d431-b241-4ede-a334-3120446a47ee None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:34.309910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d431-b241-4ede-a334-3120446a47ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:34.375094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3395d431-b241-4ede-a334-3120446a47ee None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:27:34.376296 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3395d431-b241-4ede-a334-3120446a47ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:34.422013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:34.472693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 741/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:27:34.760356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2e5ee-c1bb-43fc-a078-85dbd87fb704 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:27:34.761952 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-dce2e5ee-c1bb-43fc-a078-85dbd87fb704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:34.784989 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:34.868604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2e5ee-c1bb-43fc-a078-85dbd87fb704 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:27:34.942466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3eed3-4ca5-4c81-914c-2a7c548b8fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:27:34.943070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3eed3-4ca5-4c81-914c-2a7c548b8fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:34.943350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3eed3-4ca5-4c81-914c-2a7c548b8fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:34.943622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3eed3-4ca5-4c81-914c-2a7c548b8fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:34.945218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a2e3eed3-4ca5-4c81-914c-2a7c548b8fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:35.017919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:35.052355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3eed3-4ca5-4c81-914c-2a7c548b8fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:27:35.053789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3eed3-4ca5-4c81-914c-2a7c548b8fa1 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:27:35.071066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 743/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:27:37.260101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9b0ff-88bf-49f3-99ed-433a3726bfcc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:37.260677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9b0ff-88bf-49f3-99ed-433a3726bfcc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:37.260677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9b0ff-88bf-49f3-99ed-433a3726bfcc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:37.262080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 742/1485] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:27:37.267862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbedf2-f8eb-4369-90d8-1b10d07fe120 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:37.268303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbedf2-f8eb-4369-90d8-1b10d07fe120 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:37.268406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbedf2-f8eb-4369-90d8-1b10d07fe120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:37.332845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c1cbedf2-f8eb-4369-90d8-1b10d07fe120 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:27:37.334068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c1cbedf2-f8eb-4369-90d8-1b10d07fe120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:37.429321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 744/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:27:37.718921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9b0ff-88bf-49f3-99ed-433a3726bfcc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:27:37.720446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-88c9b0ff-88bf-49f3-99ed-433a3726bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:37.822120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9b0ff-88bf-49f3-99ed-433a3726bfcc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:27:37.894211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:37.895694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cab0e-8acd-4760-b8a8-738c1269da45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:27:37.896386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cab0e-8acd-4760-b8a8-738c1269da45 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:37.896854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cab0e-8acd-4760-b8a8-738c1269da45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:37.897311 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cab0e-8acd-4760-b8a8-738c1269da45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:37.899069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6c5cab0e-8acd-4760-b8a8-738c1269da45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:38.008880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cab0e-8acd-4760-b8a8-738c1269da45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:27:38.010261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cab0e-8acd-4760-b8a8-738c1269da45 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:27:38.027609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 743/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:27:40.302281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93b51f-6868-4d92-8f9a-c5dd9f0cc489 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:40.302816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93b51f-6868-4d92-8f9a-c5dd9f0cc489 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:40.302816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93b51f-6868-4d92-8f9a-c5dd9f0cc489 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:40.304223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 745/1488] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:27:40.309558 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87505ec-80ab-4aa7-b7d9-4cc22f513cee None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:40.309950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87505ec-80ab-4aa7-b7d9-4cc22f513cee None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:40.310112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87505ec-80ab-4aa7-b7d9-4cc22f513cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:40.375932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d87505ec-80ab-4aa7-b7d9-4cc22f513cee None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:27:40.377179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d87505ec-80ab-4aa7-b7d9-4cc22f513cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:40.429191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:40.472158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 744/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:27:40.757159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93b51f-6868-4d92-8f9a-c5dd9f0cc489 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:27:40.758676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7d93b51f-6868-4d92-8f9a-c5dd9f0cc489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:40.794360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:40.860739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93b51f-6868-4d92-8f9a-c5dd9f0cc489 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:27:40.932761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad2f0a-e1d4-4cf1-a60d-2cd06fb6d508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:27:40.933395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad2f0a-e1d4-4cf1-a60d-2cd06fb6d508 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:40.933657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad2f0a-e1d4-4cf1-a60d-2cd06fb6d508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:40.933924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad2f0a-e1d4-4cf1-a60d-2cd06fb6d508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:40.935517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-27ad2f0a-e1d4-4cf1-a60d-2cd06fb6d508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:41.015278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:41.043884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad2f0a-e1d4-4cf1-a60d-2cd06fb6d508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:27:41.045357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad2f0a-e1d4-4cf1-a60d-2cd06fb6d508 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:27:41.062994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 746/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:27:43.387793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb8f43-3010-492b-b3c0-a7ff3ad154cc None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:43.388269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb8f43-3010-492b-b3c0-a7ff3ad154cc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:43.388381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb8f43-3010-492b-b3c0-a7ff3ad154cc None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:43.390297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 745/1491] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 10:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:27:43.395557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a20de-98a4-4180-b702-cd5c816b3975 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:43.395960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a20de-98a4-4180-b702-cd5c816b3975 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:43.396101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a20de-98a4-4180-b702-cd5c816b3975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:43.460192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-227a20de-98a4-4180-b702-cd5c816b3975 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:27:43.461402 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-227a20de-98a4-4180-b702-cd5c816b3975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:43.555265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 747/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 10:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:27:43.841899 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb8f43-3010-492b-b3c0-a7ff3ad154cc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:27:43.843450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7fdb8f43-3010-492b-b3c0-a7ff3ad154cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:43.944394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb8f43-3010-492b-b3c0-a7ff3ad154cc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:27:44.016586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7d023-770c-4ee8-85a2-75274df40f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:27:44.017219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7d023-770c-4ee8-85a2-75274df40f29 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:27:44.017500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7d023-770c-4ee8-85a2-75274df40f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:27:44.017770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7d023-770c-4ee8-85a2-75274df40f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:27:44.019351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-27b7d023-770c-4ee8-85a2-75274df40f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:27:44.027707 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:44.137489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7d023-770c-4ee8-85a2-75274df40f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:27:44.138908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7d023-770c-4ee8-85a2-75274df40f29 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:27:44.156836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 746/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:27:53.553796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=82 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:54.154097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=50 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:03.411857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780effb7-6c95-4c43-be7d-4c5ca7756107 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:03.412332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780effb7-6c95-4c43-be7d-4c5ca7756107 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:03.412433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780effb7-6c95-4c43-be7d-4c5ca7756107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:03.487939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-780effb7-6c95-4c43-be7d-4c5ca7756107 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:29:03.489217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-780effb7-6c95-4c43-be7d-4c5ca7756107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:03.583708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 748/1494] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:29:03.591688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7883ab-3133-466b-a4ba-9223c3c8b6cb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:03.592166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7883ab-3133-466b-a4ba-9223c3c8b6cb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:03.592270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7883ab-3133-466b-a4ba-9223c3c8b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:03.667799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6b7883ab-3133-466b-a4ba-9223c3c8b6cb None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:29:03.668922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6b7883ab-3133-466b-a4ba-9223c3c8b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:03.765953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 747/1495] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:29:03.770556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780effb7-6c95-4c43-be7d-4c5ca7756107 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:29:03.771739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-780effb7-6c95-4c43-be7d-4c5ca7756107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:03.783425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780effb7-6c95-4c43-be7d-4c5ca7756107 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:29:03.844252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:03.877534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:29:03.878158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:03.878435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:03.878706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:03.879338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:29:03.879638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:29:03.880631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:29:03.880631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: warnings.warn(msg) Sep 26 10:29:03.880631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: Sep 26 10:29:03.881533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:29:03.892325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 749/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:29:03.900659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7883ab-3133-466b-a4ba-9223c3c8b6cb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:29:03.910189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7883ab-3133-466b-a4ba-9223c3c8b6cb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:29:03.970722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:04.004098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a4815-75ef-4a68-ab78-e320d7900705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:29:04.004728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a4815-75ef-4a68-ab78-e320d7900705 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:04.005035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a4815-75ef-4a68-ab78-e320d7900705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:04.005309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a4815-75ef-4a68-ab78-e320d7900705 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:04.005941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a4815-75ef-4a68-ab78-e320d7900705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:29:04.007667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-862a4815-75ef-4a68-ab78-e320d7900705 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:29:04.007667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 26 10:29:04.007667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: Sep 26 10:29:04.008854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a4815-75ef-4a68-ab78-e320d7900705 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:29:04.065264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 748/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:29:03 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:29:04.069400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:29:04.070919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:04.104259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc182c1d-53c6-4674-9c4d-35bf0156a106 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:29:04.195316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd2889-6b2d-4290-b7d4-a8a0e67c47ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:29:04.195919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd2889-6b2d-4290-b7d4-a8a0e67c47ff admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:04.196198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd2889-6b2d-4290-b7d4-a8a0e67c47ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:04.196494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd2889-6b2d-4290-b7d4-a8a0e67c47ff admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:04.197126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd2889-6b2d-4290-b7d4-a8a0e67c47ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:29:04.198124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-e5bd2889-6b2d-4290-b7d4-a8a0e67c47ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:29:04.198124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: warnings.warn(msg) Sep 26 10:29:04.198124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: Sep 26 10:29:04.199331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd2889-6b2d-4290-b7d4-a8a0e67c47ff admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:29:04.241178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 750/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:29:04 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:29:04.245170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a4815-75ef-4a68-ab78-e320d7900705 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:29:04.246669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-862a4815-75ef-4a68-ab78-e320d7900705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:04.307759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a4815-75ef-4a68-ab78-e320d7900705 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:29:04.401592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:04.413361 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a7a2-6844-488e-b09a-f31db5b5d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:29:04.413969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a7a2-6844-488e-b09a-f31db5b5d6eb admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:04.414253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a7a2-6844-488e-b09a-f31db5b5d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:04.414522 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a7a2-6844-488e-b09a-f31db5b5d6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:04.415161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a7a2-6844-488e-b09a-f31db5b5d6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:29:04.416176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-95c6a7a2-6844-488e-b09a-f31db5b5d6eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:29:04.416176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 26 10:29:04.416176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: Sep 26 10:29:04.417158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a7a2-6844-488e-b09a-f31db5b5d6eb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:29:04.429694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 749/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:29:04.433716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd2889-6b2d-4290-b7d4-a8a0e67c47ff admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:29:04.435214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e5bd2889-6b2d-4290-b7d4-a8a0e67c47ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:04.446926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd2889-6b2d-4290-b7d4-a8a0e67c47ff admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:29:04.471762 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:04.541784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7491b-78ad-4ed9-b3e9-2ae609982247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:29:04.542311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7491b-78ad-4ed9-b3e9-2ae609982247 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:04.542589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7491b-78ad-4ed9-b3e9-2ae609982247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:04.542857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7491b-78ad-4ed9-b3e9-2ae609982247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:04.543486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7491b-78ad-4ed9-b3e9-2ae609982247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:29:04.544472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-27d7491b-78ad-4ed9-b3e9-2ae609982247 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:29:04.544472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: warnings.warn(msg) Sep 26 10:29:04.544472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: Sep 26 10:29:04.545382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7491b-78ad-4ed9-b3e9-2ae609982247 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:29:04.557533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 751/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:29:04.561789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a7a2-6844-488e-b09a-f31db5b5d6eb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:29:04.563791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-95c6a7a2-6844-488e-b09a-f31db5b5d6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:04.596756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a7a2-6844-488e-b09a-f31db5b5d6eb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:29:04.690203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05fd62-4200-4bf6-9eae-5a036571afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:29:04.691608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05fd62-4200-4bf6-9eae-5a036571afeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:04.691904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05fd62-4200-4bf6-9eae-5a036571afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:04.692158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05fd62-4200-4bf6-9eae-5a036571afeb admin admin] PATH_INFO: `/v3/projects/d2dfee3d2c8f4cf182fff404f248d3da/users/152b3d0379a54b75abf1f9f839c9e852/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:04.719702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05fd62-4200-4bf6-9eae-5a036571afeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2dfee3d2c8f4cf182fff404f248d3da, user_id=152b3d0379a54b75abf1f9f839c9e852, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:29:04.720723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-3d05fd62-4200-4bf6-9eae-5a036571afeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:29:04.720723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 26 10:29:04.720723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: Sep 26 10:29:04.722668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05fd62-4200-4bf6-9eae-5a036571afeb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:29:04.747092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 750/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:29:04 2022] PUT /identity/v3/projects/d2dfee3d2c8f4cf182fff404f248d3da/users/152b3d0379a54b75abf1f9f839c9e852/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:29:04.759874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ccd5-ddb6-428b-996a-b945e4dee44e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:04.760169 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ccd5-ddb6-428b-996a-b945e4dee44e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:04.760451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ccd5-ddb6-428b-996a-b945e4dee44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:04.818326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-84d9ccd5-ddb6-428b-996a-b945e4dee44e None None] MFA Rules not processed for user `152b3d0379a54b75abf1f9f839c9e852`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:29:04.819447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-84d9ccd5-ddb6-428b-996a-b945e4dee44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:04.893514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 752/1502] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:29:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:29:04.906437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569498-4dcb-45c5-b2b8-135f199cddb7 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:04.906724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569498-4dcb-45c5-b2b8-135f199cddb7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:04.906998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569498-4dcb-45c5-b2b8-135f199cddb7 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:04.908324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 751/1503] 10.222.0.18 () {54 vars in 963 bytes} [Mon Sep 26 10:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:29:04.912870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16448ef-af3f-426d-8675-d80ed981b4d5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:04.913195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16448ef-af3f-426d-8675-d80ed981b4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:04.913474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16448ef-af3f-426d-8675-d80ed981b4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:04.945158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:04.988797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d16448ef-af3f-426d-8675-d80ed981b4d5 None None] MFA Rules not processed for user `561dd954e4184662b33ca3356aa08d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:29:04.990035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d16448ef-af3f-426d-8675-d80ed981b4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:05.072671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 753/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Sep 26 10:29:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:29:05.080598 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75569498-4dcb-45c5-b2b8-135f199cddb7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:29:05.082121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-75569498-4dcb-45c5-b2b8-135f199cddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:05.130904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:05.184815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75569498-4dcb-45c5-b2b8-135f199cddb7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:29:05.257867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a274e5b-cd1b-4ada-99f1-c6a647ec81de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:29:05.258468 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a274e5b-cd1b-4ada-99f1-c6a647ec81de service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:05.258742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a274e5b-cd1b-4ada-99f1-c6a647ec81de service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:05.259010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a274e5b-cd1b-4ada-99f1-c6a647ec81de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:05.260577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9a274e5b-cd1b-4ada-99f1-c6a647ec81de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:05.357317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a274e5b-cd1b-4ada-99f1-c6a647ec81de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:29:05.358753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a274e5b-cd1b-4ada-99f1-c6a647ec81de service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:29:05.363118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:05.381014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 752/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:29:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:29:05.427047 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da38d-82ed-42a6-b903-52b854dc3a5a None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:05.427338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da38d-82ed-42a6-b903-52b854dc3a5a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:05.427615 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da38d-82ed-42a6-b903-52b854dc3a5a None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:05.429161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 754/1506] 10.222.0.18 () {52 vars in 830 bytes} [Mon Sep 26 10:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:29:05.432603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a274e5b-cd1b-4ada-99f1-c6a647ec81de service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:29:05.433853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9a274e5b-cd1b-4ada-99f1-c6a647ec81de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:05.529807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a274e5b-cd1b-4ada-99f1-c6a647ec81de service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:29:05.619925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:29:05.620554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:05.620739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:05.621043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] PATH_INFO: `/v3/users/152b3d0379a54b75abf1f9f839c9e852` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:05.634197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=152b3d0379a54b75abf1f9f839c9e852)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:29:05.635666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:29:05.635666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 26 10:29:05.635666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: Sep 26 10:29:05.636870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:29:05.646216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:05.707842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152b3d0379a54b75abf1f9f839c9e852'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:29:05.716793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152b3d0379a54b75abf1f9f839c9e852'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:29:05.717317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152b3d0379a54b75abf1f9f839c9e852'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:29:05.731108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152b3d0379a54b75abf1f9f839c9e852'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:29:05.754476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152b3d0379a54b75abf1f9f839c9e852'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:29:05.759980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 753/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:29:05 2022] DELETE /identity/v3/users/152b3d0379a54b75abf1f9f839c9e852 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:29:05.764306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dbb71-f735-416f-9352-5a153c370c81 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:05.764799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dbb71-f735-416f-9352-5a153c370c81 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:05.764913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dbb71-f735-416f-9352-5a153c370c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:05.822153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8d1dbb71-f735-416f-9352-5a153c370c81 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:29:05.823337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8d1dbb71-f735-416f-9352-5a153c370c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:05.896810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:05.910269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 755/1508] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:29:05.919704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:29:05.920935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:06.025955 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a41b72-a061-4b22-9f14-5ae59f877b6a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:29:06.080825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:06.102505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a8edd-370e-4ab9-8fa2-c06f0bfe31db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:29:06.103113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8edd-370e-4ab9-8fa2-c06f0bfe31db service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:06.103391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8edd-370e-4ab9-8fa2-c06f0bfe31db service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:06.103662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8edd-370e-4ab9-8fa2-c06f0bfe31db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:06.105313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3b4a8edd-370e-4ab9-8fa2-c06f0bfe31db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:06.211258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a8edd-370e-4ab9-8fa2-c06f0bfe31db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:29:06.212616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a8edd-370e-4ab9-8fa2-c06f0bfe31db service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:29:06.231492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 754/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:29:06.604787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dbb71-f735-416f-9352-5a153c370c81 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:29:06.606181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8d1dbb71-f735-416f-9352-5a153c370c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:29:06.617609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dbb71-f735-416f-9352-5a153c370c81 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:29:06.716278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:29:06.716905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:29:06.717212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:29:06.717480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] PATH_INFO: `/v3/projects/d2dfee3d2c8f4cf182fff404f248d3da` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:29:06.728040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2dfee3d2c8f4cf182fff404f248d3da)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:29:06.729023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:29:06.729023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: warnings.warn(msg) Sep 26 10:29:06.729023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: Sep 26 10:29:06.730217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:29:06.791230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2dfee3d2c8f4cf182fff404f248d3da', 'request_id': 'req-e9ae9131-2c70-41b0-baa2-24541b107465'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:29:06.805911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2dfee3d2c8f4cf182fff404f248d3da', 'request_id': 'req-e9ae9131-2c70-41b0-baa2-24541b107465'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:29:06.811939 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2dfee3d2c8f4cf182fff404f248d3da', 'request_id': 'req-e9ae9131-2c70-41b0-baa2-24541b107465'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:29:06.839016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] The token cache is being invalidate because project d2dfee3d2c8f4cf182fff404f248d3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:29:06.839305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:29:06.839827 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e9ae9131-2c70-41b0-baa2-24541b107465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:29:06.841180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 756/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:29:06 2022] DELETE /identity/v3/projects/d2dfee3d2c8f4cf182fff404f248d3da => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:29:16.229058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=62 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:29:16.836986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:30:41.254063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c39e5c-10e1-4e8e-a02c-871eb80fe449 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:41.254616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c39e5c-10e1-4e8e-a02c-871eb80fe449 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:41.254616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c39e5c-10e1-4e8e-a02c-871eb80fe449 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:41.255886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:30:41.260746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfaac9-aa95-4689-9754-27063acb1dfa None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:41.261207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfaac9-aa95-4689-9754-27063acb1dfa None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:41.261325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfaac9-aa95-4689-9754-27063acb1dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:41.340873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-bcdfaac9-aa95-4689-9754-27063acb1dfa None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:30:41.342930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bcdfaac9-aa95-4689-9754-27063acb1dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:30:41.447001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:30:41.600153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c39e5c-10e1-4e8e-a02c-871eb80fe449 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:30:41.602439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a1c39e5c-10e1-4e8e-a02c-871eb80fe449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:30:41.719605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c39e5c-10e1-4e8e-a02c-871eb80fe449 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:30:41.725095 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b822e7-cd19-4a29-ab1a-c7214183c59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:30:41.725700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b822e7-cd19-4a29-ab1a-c7214183c59c service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:41.725980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b822e7-cd19-4a29-ab1a-c7214183c59c service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:41.726254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b822e7-cd19-4a29-ab1a-c7214183c59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:41.734180 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b822e7-cd19-4a29-ab1a-c7214183c59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:30:41.735749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b822e7-cd19-4a29-ab1a-c7214183c59c service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:30:41.745704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 756/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:30:42.805117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf3c33-80ad-43b9-8c87-03fd8ad4ecf7 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:42.805644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf3c33-80ad-43b9-8c87-03fd8ad4ecf7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:42.805644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf3c33-80ad-43b9-8c87-03fd8ad4ecf7 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:42.806937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:30:42.813128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e029-c7f3-4aae-9e99-8f1d40367f11 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:42.813568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e029-c7f3-4aae-9e99-8f1d40367f11 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:42.813708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e029-c7f3-4aae-9e99-8f1d40367f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:42.833820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3872e029-c7f3-4aae-9e99-8f1d40367f11 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:30:42.835000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3872e029-c7f3-4aae-9e99-8f1d40367f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:30:42.842637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:30:42.993144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf3c33-80ad-43b9-8c87-03fd8ad4ecf7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:30:43.007188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf3c33-80ad-43b9-8c87-03fd8ad4ecf7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:30:43.012558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cfd3a-805e-4e80-a6dd-0ca75206cf06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:30:43.013174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cfd3a-805e-4e80-a6dd-0ca75206cf06 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:43.013457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cfd3a-805e-4e80-a6dd-0ca75206cf06 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:43.013733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cfd3a-805e-4e80-a6dd-0ca75206cf06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:43.022102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cfd3a-805e-4e80-a6dd-0ca75206cf06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:30:43.023658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cfd3a-805e-4e80-a6dd-0ca75206cf06 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:30:43.032792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 759/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:30:43.165992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490a309-cd95-482f-8a59-c834913aaf55 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:43.166277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490a309-cd95-482f-8a59-c834913aaf55 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:43.166552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490a309-cd95-482f-8a59-c834913aaf55 None None] PATH_INFO: `/v3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:43.167856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 758/1517] 10.222.0.55 () {54 vars in 925 bytes} [Mon Sep 26 10:30:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:30:43.174441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388ad7b-5ab9-4c55-b32b-89eb1ddbc2d0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:43.174730 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388ad7b-5ab9-4c55-b32b-89eb1ddbc2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:43.175033 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388ad7b-5ab9-4c55-b32b-89eb1ddbc2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:43.236480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e388ad7b-5ab9-4c55-b32b-89eb1ddbc2d0 None None] MFA Rules not processed for user `794990333d3748abad7683590b0e5d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:30:43.237726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e388ad7b-5ab9-4c55-b32b-89eb1ddbc2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:30:43.254056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:30:43.308234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 760/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Mon Sep 26 10:30:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:30:52.489202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5238095-cce2-4b9f-b9ce-565ce7409dd4 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:52.489678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5238095-cce2-4b9f-b9ce-565ce7409dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:52.489792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5238095-cce2-4b9f-b9ce-565ce7409dd4 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:52.491081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 759/1519] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 10:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:30:52.496044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147f81-19d7-4904-9f00-74c100f782ae None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:52.496459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147f81-19d7-4904-9f00-74c100f782ae None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:52.496593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147f81-19d7-4904-9f00-74c100f782ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:52.516130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0f147f81-19d7-4904-9f00-74c100f782ae None None] MFA Rules not processed for user `794990333d3748abad7683590b0e5d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:30:52.517362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0f147f81-19d7-4904-9f00-74c100f782ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:30:52.527287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 761/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 10:30:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:30:52.534845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5238095-cce2-4b9f-b9ce-565ce7409dd4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:30:52.547901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5238095-cce2-4b9f-b9ce-565ce7409dd4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:30:52.552758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7e07b-7fd6-40db-9f65-1bf5d72e7a09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:30:52.553369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7e07b-7fd6-40db-9f65-1bf5d72e7a09 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:52.553649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7e07b-7fd6-40db-9f65-1bf5d72e7a09 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:52.553920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7e07b-7fd6-40db-9f65-1bf5d72e7a09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:52.562164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7e07b-7fd6-40db-9f65-1bf5d72e7a09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:30:52.563720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7e07b-7fd6-40db-9f65-1bf5d72e7a09 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:30:52.573563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 760/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:30:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:30:54.495921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623575-eb8a-4232-94d6-5b62d9c35d07 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:54.496485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623575-eb8a-4232-94d6-5b62d9c35d07 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:54.496485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623575-eb8a-4232-94d6-5b62d9c35d07 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:54.497868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:30:54.504465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aae7ae-cfc4-4c43-b855-038056f37b0f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:54.504912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aae7ae-cfc4-4c43-b855-038056f37b0f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:54.505036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aae7ae-cfc4-4c43-b855-038056f37b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:54.523851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-25aae7ae-cfc4-4c43-b855-038056f37b0f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:30:54.525058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-25aae7ae-cfc4-4c43-b855-038056f37b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:30:54.532762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:30:54.686391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623575-eb8a-4232-94d6-5b62d9c35d07 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:30:54.700636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623575-eb8a-4232-94d6-5b62d9c35d07 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:30:54.706045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330255-fb86-41d1-8daa-c8bd2c8114e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:30:54.706632 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330255-fb86-41d1-8daa-c8bd2c8114e0 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:54.706915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330255-fb86-41d1-8daa-c8bd2c8114e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:54.707188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330255-fb86-41d1-8daa-c8bd2c8114e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:54.715028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330255-fb86-41d1-8daa-c8bd2c8114e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:30:54.716594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330255-fb86-41d1-8daa-c8bd2c8114e0 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:30:54.726277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 763/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:30:55.786534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ca335-f33f-43bc-8436-8e0bf01148d0 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:55.787091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ca335-f33f-43bc-8436-8e0bf01148d0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:55.787091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ca335-f33f-43bc-8436-8e0bf01148d0 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:55.788330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 10:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:30:55.794270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb7c9a-479a-4b72-b47d-e6f5e12d62a3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:55.794718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb7c9a-479a-4b72-b47d-e6f5e12d62a3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:55.794832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb7c9a-479a-4b72-b47d-e6f5e12d62a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:55.814509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d0bb7c9a-479a-4b72-b47d-e6f5e12d62a3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:30:55.816294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d0bb7c9a-479a-4b72-b47d-e6f5e12d62a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:30:55.824294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 10:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:30:55.975579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ca335-f33f-43bc-8436-8e0bf01148d0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:30:55.990339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ca335-f33f-43bc-8436-8e0bf01148d0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:30:55.995723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a83b3e-c6f9-4345-94a2-03770a350f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:30:55.996308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83b3e-c6f9-4345-94a2-03770a350f56 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:55.996586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83b3e-c6f9-4345-94a2-03770a350f56 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:55.996854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83b3e-c6f9-4345-94a2-03770a350f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:56.005337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a83b3e-c6f9-4345-94a2-03770a350f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:30:56.006892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a83b3e-c6f9-4345-94a2-03770a350f56 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:30:56.016079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 763/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:30:59.928836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa98a-840e-4552-afb7-b948b431fdde None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:59.929470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa98a-840e-4552-afb7-b948b431fdde None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:59.929470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa98a-840e-4552-afb7-b948b431fdde None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:59.930715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:30:59.936108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aa042-8868-438a-925c-4ee5c14becd1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:30:59.936565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aa042-8868-438a-925c-4ee5c14becd1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:30:59.936667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aa042-8868-438a-925c-4ee5c14becd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:30:59.955866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e68aa042-8868-438a-925c-4ee5c14becd1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:30:59.957096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e68aa042-8868-438a-925c-4ee5c14becd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:30:59.964827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:31:00.258669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa98a-840e-4552-afb7-b948b431fdde None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:31:00.260547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d6dfa98a-840e-4552-afb7-b948b431fdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:31:00.336676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa98a-840e-4552-afb7-b948b431fdde None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:31:00.340299 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb1e63-35d0-496a-b865-0edacc4429af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:31:00.340899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb1e63-35d0-496a-b865-0edacc4429af service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:31:00.341213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb1e63-35d0-496a-b865-0edacc4429af service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:31:00.341484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb1e63-35d0-496a-b865-0edacc4429af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:31:00.350812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb1e63-35d0-496a-b865-0edacc4429af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:31:00.352219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb1e63-35d0-496a-b865-0edacc4429af service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:31:00.361832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 766/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:31:02.519032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cda781-7445-4fdf-a163-63f7d933a779 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:31:02.519591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cda781-7445-4fdf-a163-63f7d933a779 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:31:02.519591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cda781-7445-4fdf-a163-63f7d933a779 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:31:02.520931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:31:02.526164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248ede-67a0-4768-933f-dfb15e8e22f2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:31:02.526562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248ede-67a0-4768-933f-dfb15e8e22f2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:31:02.526705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248ede-67a0-4768-933f-dfb15e8e22f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:31:02.545731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-96248ede-67a0-4768-933f-dfb15e8e22f2 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:31:02.546901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-96248ede-67a0-4768-933f-dfb15e8e22f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:31:02.555056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:31:02.840745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cda781-7445-4fdf-a163-63f7d933a779 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:31:02.852160 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cda781-7445-4fdf-a163-63f7d933a779 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:31:02.855717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6458e7e-f690-4cc2-a1bc-0b3b906eb6ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:31:02.856312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6458e7e-f690-4cc2-a1bc-0b3b906eb6ab service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:31:02.856594 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6458e7e-f690-4cc2-a1bc-0b3b906eb6ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:31:02.856870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6458e7e-f690-4cc2-a1bc-0b3b906eb6ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:31:02.865627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6458e7e-f690-4cc2-a1bc-0b3b906eb6ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:31:02.867042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6458e7e-f690-4cc2-a1bc-0b3b906eb6ab service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:31:02.876244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 766/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:31:06.412052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f3a50-e9aa-4a09-ae21-f5acb78f48a5 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:31:06.412581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f3a50-e9aa-4a09-ae21-f5acb78f48a5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:31:06.412581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f3a50-e9aa-4a09-ae21-f5acb78f48a5 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:31:06.413953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:31:06.419194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129001a7-360a-4703-95a4-e8ec5dbfb158 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:31:06.419645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129001a7-360a-4703-95a4-e8ec5dbfb158 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:31:06.419750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129001a7-360a-4703-95a4-e8ec5dbfb158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:31:06.427795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=81 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:31:06.441228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-129001a7-360a-4703-95a4-e8ec5dbfb158 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:31:06.442416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-129001a7-360a-4703-95a4-e8ec5dbfb158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:31:06.450230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:31:06.749857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f3a50-e9aa-4a09-ae21-f5acb78f48a5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:31:06.751500 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8c2f3a50-e9aa-4a09-ae21-f5acb78f48a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:31:06.814673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:31:06.827993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f3a50-e9aa-4a09-ae21-f5acb78f48a5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:31:06.831557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba4efb-3802-4cf1-ab11-c57ed1b8c00f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:31:06.832151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba4efb-3802-4cf1-ab11-c57ed1b8c00f service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:31:06.832429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba4efb-3802-4cf1-ab11-c57ed1b8c00f service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:31:06.832699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba4efb-3802-4cf1-ab11-c57ed1b8c00f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:31:06.841550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba4efb-3802-4cf1-ab11-c57ed1b8c00f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:31:06.842972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba4efb-3802-4cf1-ab11-c57ed1b8c00f service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:31:06.853176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 769/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:31:08.986599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7996c6-7dee-465d-9d2d-0e13d40b7055 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:31:08.987118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7996c6-7dee-465d-9d2d-0e13d40b7055 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:31:08.987222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7996c6-7dee-465d-9d2d-0e13d40b7055 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:31:08.989077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 10:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:31:08.994266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f1ab0-2d89-4609-99ac-7ef4c087dd17 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:31:08.994687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f1ab0-2d89-4609-99ac-7ef4c087dd17 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:31:08.994802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f1ab0-2d89-4609-99ac-7ef4c087dd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:31:09.013777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-245f1ab0-2d89-4609-99ac-7ef4c087dd17 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:31:09.014959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-245f1ab0-2d89-4609-99ac-7ef4c087dd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:31:09.022697 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 10:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:31:09.324342 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7996c6-7dee-465d-9d2d-0e13d40b7055 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:31:09.326031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ee7996c6-7dee-465d-9d2d-0e13d40b7055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:31:09.339109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7996c6-7dee-465d-9d2d-0e13d40b7055 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:31:09.342592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e7d53-411c-42a3-88bc-6ff6fe8c9073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:31:09.343177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7d53-411c-42a3-88bc-6ff6fe8c9073 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:31:09.343454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7d53-411c-42a3-88bc-6ff6fe8c9073 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:31:09.343722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e7d53-411c-42a3-88bc-6ff6fe8c9073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:31:09.352756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e7d53-411c-42a3-88bc-6ff6fe8c9073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:31:09.354209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e7d53-411c-42a3-88bc-6ff6fe8c9073 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:31:09.364140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 769/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:31:19.009106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=11 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:31:19.359406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=8 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:43.067992 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29877e33-2e5b-4054-a464-67fe8e0436a0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.068689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29877e33-2e5b-4054-a464-67fe8e0436a0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.068689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29877e33-2e5b-4054-a464-67fe8e0436a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.091966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-29877e33-2e5b-4054-a464-67fe8e0436a0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.093230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-29877e33-2e5b-4054-a464-67fe8e0436a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.103978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 771/1540] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.113302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752c893-f295-4219-a343-d0c94e98979d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.113890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752c893-f295-4219-a343-d0c94e98979d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.113890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752c893-f295-4219-a343-d0c94e98979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.146460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9752c893-f295-4219-a343-d0c94e98979d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.147450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bbb4e-460f-47a5-949f-2d278f6d8fb1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.147680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9752c893-f295-4219-a343-d0c94e98979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.147786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bbb4e-460f-47a5-949f-2d278f6d8fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.148142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bbb4e-460f-47a5-949f-2d278f6d8fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.163408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 770/1541] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:32:43.168201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752c893-f295-4219-a343-d0c94e98979d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.183132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752c893-f295-4219-a343-d0c94e98979d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.191297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ea6bbb4e-460f-47a5-949f-2d278f6d8fb1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.192767 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ea6bbb4e-460f-47a5-949f-2d278f6d8fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.193229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0d98-e066-41ae-b8ae-a052e49eb1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.194092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0d98-e066-41ae-b8ae-a052e49eb1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.194590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0d98-e066-41ae-b8ae-a052e49eb1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.195073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0d98-e066-41ae-b8ae-a052e49eb1c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.195939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0d98-e066-41ae-b8ae-a052e49eb1c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:32:43.196464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0d98-e066-41ae-b8ae-a052e49eb1c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.197988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-27cb0d98-e066-41ae-b8ae-a052e49eb1c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:32:43.197988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 26 10:32:43.197988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: Sep 26 10:32:43.199262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0d98-e066-41ae-b8ae-a052e49eb1c3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.225000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 772/1542] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:32:43.227555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ea517-82b0-4221-a094-3edde4b8e467 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.229118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ea517-82b0-4221-a094-3edde4b8e467 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.229800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ea517-82b0-4221-a094-3edde4b8e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.235164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 771/1543] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:32:43.236981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef935cc-393e-4718-b4b7-d451b21a1b98 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.238158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef935cc-393e-4718-b4b7-d451b21a1b98 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.239162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef935cc-393e-4718-b4b7-d451b21a1b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.262847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a71ea517-82b0-4221-a094-3edde4b8e467 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.264058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a71ea517-82b0-4221-a094-3edde4b8e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.266230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8ef935cc-393e-4718-b4b7-d451b21a1b98 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.268180 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8ef935cc-393e-4718-b4b7-d451b21a1b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.275847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 773/1544] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.278657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b685e-4bd6-441b-9d28-6abcae8d6cff None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.279565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b685e-4bd6-441b-9d28-6abcae8d6cff None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.279848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b685e-4bd6-441b-9d28-6abcae8d6cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.285859 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 772/1545] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.287078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef935cc-393e-4718-b4b7-d451b21a1b98 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.297306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef935cc-393e-4718-b4b7-d451b21a1b98 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.302837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ba7b685e-4bd6-441b-9d28-6abcae8d6cff None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.303372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e585f-9f9e-44fb-bcb7-95a3d3256e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.304098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ba7b685e-4bd6-441b-9d28-6abcae8d6cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.304250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e585f-9f9e-44fb-bcb7-95a3d3256e3c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.304426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e585f-9f9e-44fb-bcb7-95a3d3256e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.304690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e585f-9f9e-44fb-bcb7-95a3d3256e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.305371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e585f-9f9e-44fb-bcb7-95a3d3256e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.307447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e585f-9f9e-44fb-bcb7-95a3d3256e3c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.312335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 774/1546] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.313556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14ba5-c064-463a-bea6-936ca3cac66e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.313840 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14ba5-c064-463a-bea6-936ca3cac66e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.314113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14ba5-c064-463a-bea6-936ca3cac66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.333716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-47a14ba5-c064-463a-bea6-936ca3cac66e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.335035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-47a14ba5-c064-463a-bea6-936ca3cac66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.343466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 775/1547] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.344626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfccc80-ae52-41d0-be6b-8240a0b1d1a3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.344735 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 773/1548] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:43.345187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfccc80-ae52-41d0-be6b-8240a0b1d1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.345474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfccc80-ae52-41d0-be6b-8240a0b1d1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.345994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7886-bc23-470d-a039-dcf22354e121 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.346285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7886-bc23-470d-a039-dcf22354e121 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.346562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a7886-bc23-470d-a039-dcf22354e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.370907 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-dcfccc80-ae52-41d0-be6b-8240a0b1d1a3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.371423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2d9a7886-bc23-470d-a039-dcf22354e121 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.372107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-dcfccc80-ae52-41d0-be6b-8240a0b1d1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.372595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2d9a7886-bc23-470d-a039-dcf22354e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.432615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 774/1549] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.433149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 776/1550] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.434412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7bb26-4a53-4153-8230-5aea7a5b0f2c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.434700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7bb26-4a53-4153-8230-5aea7a5b0f2c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.434975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7bb26-4a53-4153-8230-5aea7a5b0f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.438352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3eb92-d716-4ae6-b904-82f76d7a1507 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.438703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3eb92-d716-4ae6-b904-82f76d7a1507 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.439170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3eb92-d716-4ae6-b904-82f76d7a1507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.456977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-65d7bb26-4a53-4153-8230-5aea7a5b0f2c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.458238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-65d7bb26-4a53-4153-8230-5aea7a5b0f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.458830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f9b3eb92-d716-4ae6-b904-82f76d7a1507 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.459984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f9b3eb92-d716-4ae6-b904-82f76d7a1507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.466026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 775/1551] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.467239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdc93-d3e3-4e27-829c-df722ead1a64 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.467524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdc93-d3e3-4e27-829c-df722ead1a64 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.467793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdc93-d3e3-4e27-829c-df722ead1a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.471945 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 777/1552] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.472870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3eb92-d716-4ae6-b904-82f76d7a1507 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.482789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3eb92-d716-4ae6-b904-82f76d7a1507 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.487430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95864ba-c4bb-42fc-b8aa-0437dbaa8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.487563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-de6bdc93-d3e3-4e27-829c-df722ead1a64 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.487959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95864ba-c4bb-42fc-b8aa-0437dbaa8d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.488267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95864ba-c4bb-42fc-b8aa-0437dbaa8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.488543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95864ba-c4bb-42fc-b8aa-0437dbaa8d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.488653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-de6bdc93-d3e3-4e27-829c-df722ead1a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.489215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95864ba-c4bb-42fc-b8aa-0437dbaa8d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:32:43.489546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95864ba-c4bb-42fc-b8aa-0437dbaa8d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.491760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95864ba-c4bb-42fc-b8aa-0437dbaa8d5b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.496926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 776/1553] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.501106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bdc93-d3e3-4e27-829c-df722ead1a64 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.510023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 778/1554] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:32:43.510023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59adc2d-73b2-4587-88dc-538f80751001 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.510023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59adc2d-73b2-4587-88dc-538f80751001 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.510023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59adc2d-73b2-4587-88dc-538f80751001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.511356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bdc93-d3e3-4e27-829c-df722ead1a64 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.515973 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bac409-e320-467b-8b8a-75bf1a75666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.516570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bac409-e320-467b-8b8a-75bf1a75666a admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.516851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bac409-e320-467b-8b8a-75bf1a75666a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.517161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bac409-e320-467b-8b8a-75bf1a75666a admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.517789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bac409-e320-467b-8b8a-75bf1a75666a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.518805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-59bac409-e320-467b-8b8a-75bf1a75666a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:32:43.518805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 26 10:32:43.518805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: Sep 26 10:32:43.520004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bac409-e320-467b-8b8a-75bf1a75666a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.525798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b59adc2d-73b2-4587-88dc-538f80751001 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.526988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b59adc2d-73b2-4587-88dc-538f80751001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.540341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 779/1555] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.540341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f6232-98db-4486-b3c4-12b518107070 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.540341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f6232-98db-4486-b3c4-12b518107070 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.540341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f6232-98db-4486-b3c4-12b518107070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.542585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 777/1556] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:43.543739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e95da-6afe-4607-bb4d-639780a25463 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.544032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e95da-6afe-4607-bb4d-639780a25463 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.544347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e95da-6afe-4607-bb4d-639780a25463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.559711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-545f6232-98db-4486-b3c4-12b518107070 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.560918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-545f6232-98db-4486-b3c4-12b518107070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.564374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5f6e95da-6afe-4607-bb4d-639780a25463 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.565584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5f6e95da-6afe-4607-bb4d-639780a25463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.573721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 780/1557] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.573721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f6232-98db-4486-b3c4-12b518107070 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.580042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 778/1558] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.580042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e95da-6afe-4607-bb4d-639780a25463 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.581053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f6232-98db-4486-b3c4-12b518107070 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.585670 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010640b7-21f7-4d73-b891-1e40a0dda9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.586262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010640b7-21f7-4d73-b891-1e40a0dda9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.586538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010640b7-21f7-4d73-b891-1e40a0dda9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.586808 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010640b7-21f7-4d73-b891-1e40a0dda9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.587461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010640b7-21f7-4d73-b891-1e40a0dda9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:32:43.587761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010640b7-21f7-4d73-b891-1e40a0dda9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.588149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e95da-6afe-4607-bb4d-639780a25463 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.589507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010640b7-21f7-4d73-b891-1e40a0dda9e5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.593028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936febf8-493f-40c7-8cf0-108017bb0378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.593658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936febf8-493f-40c7-8cf0-108017bb0378 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.593928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936febf8-493f-40c7-8cf0-108017bb0378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.594229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936febf8-493f-40c7-8cf0-108017bb0378 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.594833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936febf8-493f-40c7-8cf0-108017bb0378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:32:43.595130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936febf8-493f-40c7-8cf0-108017bb0378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.596700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936febf8-493f-40c7-8cf0-108017bb0378 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.603689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 781/1559] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:32:43.603689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a751a-aa9f-41b1-b799-0227d69968c7 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.603689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a751a-aa9f-41b1-b799-0227d69968c7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.604048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a751a-aa9f-41b1-b799-0227d69968c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.609569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 779/1560] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:32:43.610350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936febf8-493f-40c7-8cf0-108017bb0378 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.622650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936febf8-493f-40c7-8cf0-108017bb0378 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.627402 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59097d5e-65cf-4030-af0b-3a767187099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.628025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59097d5e-65cf-4030-af0b-3a767187099b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.628313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59097d5e-65cf-4030-af0b-3a767187099b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.628583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59097d5e-65cf-4030-af0b-3a767187099b admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.629250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59097d5e-65cf-4030-af0b-3a767187099b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.629374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-345a751a-aa9f-41b1-b799-0227d69968c7 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:43.630550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-345a751a-aa9f-41b1-b799-0227d69968c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:43.631156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59097d5e-65cf-4030-af0b-3a767187099b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.638387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 782/1561] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:43.642006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a751a-aa9f-41b1-b799-0227d69968c7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.648704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a751a-aa9f-41b1-b799-0227d69968c7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.653619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c481c-daca-430c-938f-760e5e0194cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.654243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c481c-daca-430c-938f-760e5e0194cd admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.654531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c481c-daca-430c-938f-760e5e0194cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.654805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c481c-daca-430c-938f-760e5e0194cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.655459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c481c-daca-430c-938f-760e5e0194cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:32:43.655752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c481c-daca-430c-938f-760e5e0194cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.657378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c481c-daca-430c-938f-760e5e0194cd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.664013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 780/1562] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:43.664013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59097d5e-65cf-4030-af0b-3a767187099b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.677104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 783/1563] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:32:43.677104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c481c-daca-430c-938f-760e5e0194cd admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.688057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c481c-daca-430c-938f-760e5e0194cd admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.699406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:43.732941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59097d5e-65cf-4030-af0b-3a767187099b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.737727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2f270-509b-41d3-9dd8-6a069cc1a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.738263 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f270-509b-41d3-9dd8-6a069cc1a815 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.738541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f270-509b-41d3-9dd8-6a069cc1a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.738811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f270-509b-41d3-9dd8-6a069cc1a815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.739449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2f270-509b-41d3-9dd8-6a069cc1a815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.741648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2f270-509b-41d3-9dd8-6a069cc1a815 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.747350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93939c-4c62-43c5-86e0-87f8699e8a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.747955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93939c-4c62-43c5-86e0-87f8699e8a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.748236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93939c-4c62-43c5-86e0-87f8699e8a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.748508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93939c-4c62-43c5-86e0-87f8699e8a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.749181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93939c-4c62-43c5-86e0-87f8699e8a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:32:43.749504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93939c-4c62-43c5-86e0-87f8699e8a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.751065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93939c-4c62-43c5-86e0-87f8699e8a71 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.751553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 781/1564] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:43.752371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2f270-509b-41d3-9dd8-6a069cc1a815 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.755667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:43.761918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2f270-509b-41d3-9dd8-6a069cc1a815 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.765689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 784/1565] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:32:43.766501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799bb42-57fb-4104-abce-c95468e9e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.766813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93939c-4c62-43c5-86e0-87f8699e8a71 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.767285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799bb42-57fb-4104-abce-c95468e9e502 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.767571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799bb42-57fb-4104-abce-c95468e9e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.767842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799bb42-57fb-4104-abce-c95468e9e502 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.768472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799bb42-57fb-4104-abce-c95468e9e502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:32:43.768773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799bb42-57fb-4104-abce-c95468e9e502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.770548 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799bb42-57fb-4104-abce-c95468e9e502 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.777998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93939c-4c62-43c5-86e0-87f8699e8a71 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.783362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 782/1566] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:32:43.783539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66370e44-73c7-42db-b840-9a70c2532bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.783961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66370e44-73c7-42db-b840-9a70c2532bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.784295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66370e44-73c7-42db-b840-9a70c2532bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.784572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66370e44-73c7-42db-b840-9a70c2532bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.785233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66370e44-73c7-42db-b840-9a70c2532bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.785929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799bb42-57fb-4104-abce-c95468e9e502 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.786611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-66370e44-73c7-42db-b840-9a70c2532bd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:32:43.786611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: warnings.warn(msg) Sep 26 10:32:43.786611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: Sep 26 10:32:43.788295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66370e44-73c7-42db-b840-9a70c2532bd3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.796667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799bb42-57fb-4104-abce-c95468e9e502 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.801437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2a9fc-146e-4b8b-81d3-18f6422b73ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.802057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2a9fc-146e-4b8b-81d3-18f6422b73ef admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.802367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2a9fc-146e-4b8b-81d3-18f6422b73ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.802641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2a9fc-146e-4b8b-81d3-18f6422b73ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.803364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2a9fc-146e-4b8b-81d3-18f6422b73ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.805164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2a9fc-146e-4b8b-81d3-18f6422b73ef admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.816294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 785/1567] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:43.817896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66370e44-73c7-42db-b840-9a70c2532bd3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.838440 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 783/1568] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:43.838440 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2a9fc-146e-4b8b-81d3-18f6422b73ef admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.881081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66370e44-73c7-42db-b840-9a70c2532bd3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.899828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2a9fc-146e-4b8b-81d3-18f6422b73ef admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.904628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd865cf-1d80-4b07-9256-d7598fc1addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.905270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd865cf-1d80-4b07-9256-d7598fc1addd admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.905554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd865cf-1d80-4b07-9256-d7598fc1addd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.905829 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd865cf-1d80-4b07-9256-d7598fc1addd admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.906460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd865cf-1d80-4b07-9256-d7598fc1addd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.908363 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd865cf-1d80-4b07-9256-d7598fc1addd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.930125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 784/1569] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:43.930838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd865cf-1d80-4b07-9256-d7598fc1addd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.942259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cf622-3706-405b-94f4-69af784c3ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.943007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cf622-3706-405b-94f4-69af784c3ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.943298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cf622-3706-405b-94f4-69af784c3ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.943575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cf622-3706-405b-94f4-69af784c3ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.944227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cf622-3706-405b-94f4-69af784c3ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:32:43.944535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cf622-3706-405b-94f4-69af784c3ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.945315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd865cf-1d80-4b07-9256-d7598fc1addd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.946183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cf622-3706-405b-94f4-69af784c3ce5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.951811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eca173-a001-49ea-b8da-85c515782598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.952411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eca173-a001-49ea-b8da-85c515782598 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.952740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eca173-a001-49ea-b8da-85c515782598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.953156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eca173-a001-49ea-b8da-85c515782598 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.953786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eca173-a001-49ea-b8da-85c515782598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.955651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eca173-a001-49ea-b8da-85c515782598 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.958413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 786/1570] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:32:43.966028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cf622-3706-405b-94f4-69af784c3ce5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:43.977561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cf622-3706-405b-94f4-69af784c3ce5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:43.983051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad800a-090f-4962-952b-9ac6442630ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:43.983720 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad800a-090f-4962-952b-9ac6442630ee admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:43.984193 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad800a-090f-4962-952b-9ac6442630ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:43.984473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad800a-090f-4962-952b-9ac6442630ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:43.985180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad800a-090f-4962-952b-9ac6442630ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:43.986815 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad800a-090f-4962-952b-9ac6442630ee admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:43.994432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 785/1571] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:43.995194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eca173-a001-49ea-b8da-85c515782598 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.001534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 787/1572] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.001534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad800a-090f-4962-952b-9ac6442630ee admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.010658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad800a-090f-4962-952b-9ac6442630ee admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.063235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eca173-a001-49ea-b8da-85c515782598 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.069648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096e08d-f583-489c-a51b-5f08baa85269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.070356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096e08d-f583-489c-a51b-5f08baa85269 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.070576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec0ad5-5dd6-42bb-b3b4-e4fac41c70de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.070688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096e08d-f583-489c-a51b-5f08baa85269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.070947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096e08d-f583-489c-a51b-5f08baa85269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.071179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec0ad5-5dd6-42bb-b3b4-e4fac41c70de admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.071460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec0ad5-5dd6-42bb-b3b4-e4fac41c70de admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.071700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096e08d-f583-489c-a51b-5f08baa85269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.071817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec0ad5-5dd6-42bb-b3b4-e4fac41c70de admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.072341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec0ad5-5dd6-42bb-b3b4-e4fac41c70de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.074267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096e08d-f583-489c-a51b-5f08baa85269 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.074414 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec0ad5-5dd6-42bb-b3b4-e4fac41c70de admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.079378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:44.086708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:44.107024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 786/1573] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:44.107558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 788/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:43 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:44.108235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec0ad5-5dd6-42bb-b3b4-e4fac41c70de admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.108475 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096e08d-f583-489c-a51b-5f08baa85269 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.169322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec0ad5-5dd6-42bb-b3b4-e4fac41c70de admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.170601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096e08d-f583-489c-a51b-5f08baa85269 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.173966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0b2bd-ff76-4044-9dd7-a05f976453eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.174568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b2bd-ff76-4044-9dd7-a05f976453eb admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.174850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b2bd-ff76-4044-9dd7-a05f976453eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.175106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c40c-ca98-4b7f-8a43-c013800a5d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.175243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b2bd-ff76-4044-9dd7-a05f976453eb admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.175710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c40c-ca98-4b7f-8a43-c013800a5d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.175811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0b2bd-ff76-4044-9dd7-a05f976453eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.176237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c40c-ca98-4b7f-8a43-c013800a5d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.176407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c40c-ca98-4b7f-8a43-c013800a5d7c admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.177218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682c40c-ca98-4b7f-8a43-c013800a5d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.178302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0b2bd-ff76-4044-9dd7-a05f976453eb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.179739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682c40c-ca98-4b7f-8a43-c013800a5d7c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.200145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 787/1575] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:44 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:44.200984 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0b2bd-ff76-4044-9dd7-a05f976453eb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.201365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 789/1576] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:44 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:44.202149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c40c-ca98-4b7f-8a43-c013800a5d7c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.211609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0b2bd-ff76-4044-9dd7-a05f976453eb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.211909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c40c-ca98-4b7f-8a43-c013800a5d7c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.216253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e648837-9d14-4a7d-aac3-5291ae1d7a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.216408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65c5bf-f7d9-4cfb-b914-30fcbf398176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.216845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e648837-9d14-4a7d-aac3-5291ae1d7a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.216977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65c5bf-f7d9-4cfb-b914-30fcbf398176 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.217159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e648837-9d14-4a7d-aac3-5291ae1d7a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.217275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65c5bf-f7d9-4cfb-b914-30fcbf398176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.217463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e648837-9d14-4a7d-aac3-5291ae1d7a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.217567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65c5bf-f7d9-4cfb-b914-30fcbf398176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.218075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65c5bf-f7d9-4cfb-b914-30fcbf398176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.218169 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e648837-9d14-4a7d-aac3-5291ae1d7a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.219684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e648837-9d14-4a7d-aac3-5291ae1d7a32 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.219927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65c5bf-f7d9-4cfb-b914-30fcbf398176 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.230294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 788/1577] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.231060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e648837-9d14-4a7d-aac3-5291ae1d7a32 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.241645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e648837-9d14-4a7d-aac3-5291ae1d7a32 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.246525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515a181-fc88-4380-a3de-160b1b3509ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.247042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515a181-fc88-4380-a3de-160b1b3509ba admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.247319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515a181-fc88-4380-a3de-160b1b3509ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.247587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515a181-fc88-4380-a3de-160b1b3509ba admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.248196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515a181-fc88-4380-a3de-160b1b3509ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.250107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515a181-fc88-4380-a3de-160b1b3509ba admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.251280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 790/1578] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:44 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:44.252085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65c5bf-f7d9-4cfb-b914-30fcbf398176 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.274501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 789/1579] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:44 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:44.274501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515a181-fc88-4380-a3de-160b1b3509ba admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.282193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515a181-fc88-4380-a3de-160b1b3509ba admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.319668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65c5bf-f7d9-4cfb-b914-30fcbf398176 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.325067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576bc95-30f6-49b9-8c66-5ac8dd7987aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.325802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576bc95-30f6-49b9-8c66-5ac8dd7987aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.326468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576bc95-30f6-49b9-8c66-5ac8dd7987aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.326744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576bc95-30f6-49b9-8c66-5ac8dd7987aa admin admin] PATH_INFO: `/v3/projects/e7f0397f30c44ace99903e9f3fe2d2ed/users/632e917894ac4305ab441182dc9dad74/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.342191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cac53-ec19-447b-9715-0732a383f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.342913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cac53-ec19-447b-9715-0732a383f696 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.343202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cac53-ec19-447b-9715-0732a383f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.343479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cac53-ec19-447b-9715-0732a383f696 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.343636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576bc95-30f6-49b9-8c66-5ac8dd7987aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f0397f30c44ace99903e9f3fe2d2ed, user_id=632e917894ac4305ab441182dc9dad74, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.344111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cac53-ec19-447b-9715-0732a383f696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.344663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-5576bc95-30f6-49b9-8c66-5ac8dd7987aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:32:44.344663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: warnings.warn(msg) Sep 26 10:32:44.344663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: Sep 26 10:32:44.346279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cac53-ec19-447b-9715-0732a383f696 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.346988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576bc95-30f6-49b9-8c66-5ac8dd7987aa admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.373029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 790/1580] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:44 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:44.384540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cac53-ec19-447b-9715-0732a383f696 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.384748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 791/1581] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:44 2022] PUT /identity/v3/projects/e7f0397f30c44ace99903e9f3fe2d2ed/users/632e917894ac4305ab441182dc9dad74/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:44.384748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576bc95-30f6-49b9-8c66-5ac8dd7987aa admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.386521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cac53-ec19-447b-9715-0732a383f696 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.424509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:44.428200 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:44.449070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576bc95-30f6-49b9-8c66-5ac8dd7987aa admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.451113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48415c73-0cf9-4797-bf8c-6c64185bb7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.451721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48415c73-0cf9-4797-bf8c-6c64185bb7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.451997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48415c73-0cf9-4797-bf8c-6c64185bb7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.452270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48415c73-0cf9-4797-bf8c-6c64185bb7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.453049 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48415c73-0cf9-4797-bf8c-6c64185bb7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.453825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50634cd-af6f-44d5-b913-8a7cc88b4d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.454431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50634cd-af6f-44d5-b913-8a7cc88b4d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.454713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50634cd-af6f-44d5-b913-8a7cc88b4d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.454960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48415c73-0cf9-4797-bf8c-6c64185bb7f7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.455076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50634cd-af6f-44d5-b913-8a7cc88b4d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.455612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50634cd-af6f-44d5-b913-8a7cc88b4d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.457236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50634cd-af6f-44d5-b913-8a7cc88b4d80 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.467314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 792/1582] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.468695 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50634cd-af6f-44d5-b913-8a7cc88b4d80 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.480721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50634cd-af6f-44d5-b913-8a7cc88b4d80 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.481029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 791/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:44 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:44.482446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48415c73-0cf9-4797-bf8c-6c64185bb7f7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.486447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568896bb-c1c7-4033-92c0-625d081a4aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.487048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568896bb-c1c7-4033-92c0-625d081a4aab admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.487338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568896bb-c1c7-4033-92c0-625d081a4aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.487609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568896bb-c1c7-4033-92c0-625d081a4aab admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.488245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568896bb-c1c7-4033-92c0-625d081a4aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.490773 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568896bb-c1c7-4033-92c0-625d081a4aab admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.492613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48415c73-0cf9-4797-bf8c-6c64185bb7f7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.497228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28990d14-6a9f-4995-862c-1fe3e379e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.497746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28990d14-6a9f-4995-862c-1fe3e379e75e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.498024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28990d14-6a9f-4995-862c-1fe3e379e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.498295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28990d14-6a9f-4995-862c-1fe3e379e75e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.498952 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28990d14-6a9f-4995-862c-1fe3e379e75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.500509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28990d14-6a9f-4995-862c-1fe3e379e75e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.501690 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 793/1584] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.502352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568896bb-c1c7-4033-92c0-625d081a4aab admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.511230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 792/1585] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.512083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28990d14-6a9f-4995-862c-1fe3e379e75e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.513094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568896bb-c1c7-4033-92c0-625d081a4aab admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.518037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f825d2c-7883-4ae3-8e99-e81daa2b908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.518623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f825d2c-7883-4ae3-8e99-e81daa2b908b admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.518960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f825d2c-7883-4ae3-8e99-e81daa2b908b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.519233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f825d2c-7883-4ae3-8e99-e81daa2b908b admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.519857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f825d2c-7883-4ae3-8e99-e81daa2b908b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.522057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28990d14-6a9f-4995-862c-1fe3e379e75e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.522327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f825d2c-7883-4ae3-8e99-e81daa2b908b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.526538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5418b94-e44d-420a-83e3-567dd91a4f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.527099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5418b94-e44d-420a-83e3-567dd91a4f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.527375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5418b94-e44d-420a-83e3-567dd91a4f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.527646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5418b94-e44d-420a-83e3-567dd91a4f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.528260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5418b94-e44d-420a-83e3-567dd91a4f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.529841 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5418b94-e44d-420a-83e3-567dd91a4f8d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.541327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 793/1586] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.542195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5418b94-e44d-420a-83e3-567dd91a4f8d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.546116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 794/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:44 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:44.547305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132fab9-b88c-416c-a999-9bfb8dc4dcaf None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.547595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132fab9-b88c-416c-a999-9bfb8dc4dcaf None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.547868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132fab9-b88c-416c-a999-9bfb8dc4dcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.552364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5418b94-e44d-420a-83e3-567dd91a4f8d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.556868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e2e8e-0690-41af-a337-e389e45b88fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.557477 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e2e8e-0690-41af-a337-e389e45b88fd admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.557754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e2e8e-0690-41af-a337-e389e45b88fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.558021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e2e8e-0690-41af-a337-e389e45b88fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.558639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e2e8e-0690-41af-a337-e389e45b88fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.560210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e2e8e-0690-41af-a337-e389e45b88fd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.570219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 794/1588] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.571066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e2e8e-0690-41af-a337-e389e45b88fd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.576358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c132fab9-b88c-416c-a999-9bfb8dc4dcaf None None] MFA Rules not processed for user `632e917894ac4305ab441182dc9dad74`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:44.577627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c132fab9-b88c-416c-a999-9bfb8dc4dcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:44.580536 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e2e8e-0690-41af-a337-e389e45b88fd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.586512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2a94-041e-443a-a626-1fd52602cf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.587110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2a94-041e-443a-a626-1fd52602cf8e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.587386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2a94-041e-443a-a626-1fd52602cf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.587654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2a94-041e-443a-a626-1fd52602cf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.588282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2a94-041e-443a-a626-1fd52602cf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.589884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2a94-041e-443a-a626-1fd52602cf8e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.601310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 795/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.602106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2a94-041e-443a-a626-1fd52602cf8e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.611442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2a94-041e-443a-a626-1fd52602cf8e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.615974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482ae56-acae-467e-be51-86231860a8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.616541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482ae56-acae-467e-be51-86231860a8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.616819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482ae56-acae-467e-be51-86231860a8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.617122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482ae56-acae-467e-be51-86231860a8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.617740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482ae56-acae-467e-be51-86231860a8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.619293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482ae56-acae-467e-be51-86231860a8a4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.629036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 796/1590] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.630093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482ae56-acae-467e-be51-86231860a8a4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.639642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482ae56-acae-467e-be51-86231860a8a4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.644229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d7c80-c311-4291-be1e-e71a40499f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.644786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d7c80-c311-4291-be1e-e71a40499f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.645101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d7c80-c311-4291-be1e-e71a40499f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.645375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d7c80-c311-4291-be1e-e71a40499f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.646535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d7c80-c311-4291-be1e-e71a40499f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.646850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 795/1591] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:44.647660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132fab9-b88c-416c-a999-9bfb8dc4dcaf None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.650320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d7c80-c311-4291-be1e-e71a40499f49 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.658384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132fab9-b88c-416c-a999-9bfb8dc4dcaf None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.663223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 797/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.664337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b886bd-0950-4d1b-8ec7-87b8a8cfae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.665061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b886bd-0950-4d1b-8ec7-87b8a8cfae4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.665351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b886bd-0950-4d1b-8ec7-87b8a8cfae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.665635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b886bd-0950-4d1b-8ec7-87b8a8cfae4b admin admin] PATH_INFO: `/v3/projects/67fe0b8641f6465e89a52533ed91ae4b/users/8361c48f79a7419688d3f6b7289953e7/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.667597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d7c80-c311-4291-be1e-e71a40499f49 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.679368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d7c80-c311-4291-be1e-e71a40499f49 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.682618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b886bd-0950-4d1b-8ec7-87b8a8cfae4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fe0b8641f6465e89a52533ed91ae4b, user_id=8361c48f79a7419688d3f6b7289953e7, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.684105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051229b-7cda-4b04-9abd-56bb150ef156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.684732 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051229b-7cda-4b04-9abd-56bb150ef156 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.684993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051229b-7cda-4b04-9abd-56bb150ef156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.685352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051229b-7cda-4b04-9abd-56bb150ef156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.685499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b886bd-0950-4d1b-8ec7-87b8a8cfae4b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.685891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051229b-7cda-4b04-9abd-56bb150ef156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.687605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051229b-7cda-4b04-9abd-56bb150ef156 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.701759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 796/1593] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:44 2022] PUT /identity/v3/projects/67fe0b8641f6465e89a52533ed91ae4b/users/8361c48f79a7419688d3f6b7289953e7/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:44.702286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 798/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.702700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b886bd-0950-4d1b-8ec7-87b8a8cfae4b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.703717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051229b-7cda-4b04-9abd-56bb150ef156 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.714924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051229b-7cda-4b04-9abd-56bb150ef156 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.768346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b886bd-0950-4d1b-8ec7-87b8a8cfae4b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.771584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb5269-f47a-466c-9b50-e66154e11bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.772285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb5269-f47a-466c-9b50-e66154e11bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.772636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb5269-f47a-466c-9b50-e66154e11bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.773009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb5269-f47a-466c-9b50-e66154e11bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.773129 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a46243-e02f-418a-a362-1a0eac90e995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.773772 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb5269-f47a-466c-9b50-e66154e11bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.773892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a46243-e02f-418a-a362-1a0eac90e995 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.774087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a46243-e02f-418a-a362-1a0eac90e995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.774363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a46243-e02f-418a-a362-1a0eac90e995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.775040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a46243-e02f-418a-a362-1a0eac90e995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.775684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb5269-f47a-466c-9b50-e66154e11bc0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.776568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a46243-e02f-418a-a362-1a0eac90e995 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.789479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 797/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.789646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 799/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.789731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a46243-e02f-418a-a362-1a0eac90e995 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.789844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb5269-f47a-466c-9b50-e66154e11bc0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.798506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a46243-e02f-418a-a362-1a0eac90e995 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.799098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb5269-f47a-466c-9b50-e66154e11bc0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.803775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea1a1c-a4db-4e04-9b18-47c5f8801be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.804131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ac92f-f235-4a20-ad3e-247910e5cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.804407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea1a1c-a4db-4e04-9b18-47c5f8801be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.804689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea1a1c-a4db-4e04-9b18-47c5f8801be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.804795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ac92f-f235-4a20-ad3e-247910e5cfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.804979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea1a1c-a4db-4e04-9b18-47c5f8801be8 admin admin] PATH_INFO: `/v3/projects/b4e717dbe1904e2ba39b4ccabd2e2835/users/7e88c48d013044d5b2fc270c74013872/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.805106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ac92f-f235-4a20-ad3e-247910e5cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.805271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ac92f-f235-4a20-ad3e-247910e5cfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.805892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ac92f-f235-4a20-ad3e-247910e5cfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.807459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ac92f-f235-4a20-ad3e-247910e5cfa2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.808634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:44.822272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 800/1597] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.822272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ac92f-f235-4a20-ad3e-247910e5cfa2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.822572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea1a1c-a4db-4e04-9b18-47c5f8801be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e717dbe1904e2ba39b4ccabd2e2835, user_id=7e88c48d013044d5b2fc270c74013872, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.824441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea1a1c-a4db-4e04-9b18-47c5f8801be8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.829431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ac92f-f235-4a20-ad3e-247910e5cfa2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.834154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fbc75-b154-4cbe-b2c8-4d5a47624314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.834776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fbc75-b154-4cbe-b2c8-4d5a47624314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.835058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fbc75-b154-4cbe-b2c8-4d5a47624314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.835331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fbc75-b154-4cbe-b2c8-4d5a47624314 admin admin] PATH_INFO: `/v3/projects/f754d7d9134742749850328b574451e8/users/cbfb851b4c0f4a02b6c67ac71883f27c/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.838000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 798/1598] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:44 2022] PUT /identity/v3/projects/b4e717dbe1904e2ba39b4ccabd2e2835/users/7e88c48d013044d5b2fc270c74013872/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:44.849634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9013e16-fed0-4718-9512-f1dbeadcfb2c None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.849634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9013e16-fed0-4718-9512-f1dbeadcfb2c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.849634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9013e16-fed0-4718-9512-f1dbeadcfb2c None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.849634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 799/1599] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 10:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:32:44.849634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fecd12-4bc5-496b-8ff3-d367d1d15ae2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.849634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fecd12-4bc5-496b-8ff3-d367d1d15ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.850290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fecd12-4bc5-496b-8ff3-d367d1d15ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.862248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fbc75-b154-4cbe-b2c8-4d5a47624314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f754d7d9134742749850328b574451e8, user_id=cbfb851b4c0f4a02b6c67ac71883f27c, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.865496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fbc75-b154-4cbe-b2c8-4d5a47624314 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.867266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e4fecd12-4bc5-496b-8ff3-d367d1d15ae2 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:44.868467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e4fecd12-4bc5-496b-8ff3-d367d1d15ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:44.878974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 801/1600] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:44 2022] PUT /identity/v3/projects/f754d7d9134742749850328b574451e8/users/cbfb851b4c0f4a02b6c67ac71883f27c/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:44.879880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fbc75-b154-4cbe-b2c8-4d5a47624314 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.889000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:44.938396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 800/1601] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:44.939393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fecd12-4bc5-496b-8ff3-d367d1d15ae2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.943150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fbc75-b154-4cbe-b2c8-4d5a47624314 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.947953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a168b3-06b3-4400-a575-93ed4c0437d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.948870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a168b3-06b3-4400-a575-93ed4c0437d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.949188 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a168b3-06b3-4400-a575-93ed4c0437d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.949463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a168b3-06b3-4400-a575-93ed4c0437d4 admin admin] PATH_INFO: `/v3/projects/aed6e3e3c5994aac8ff1bfbb7f754000/users/e0589d6270464a4c8f5ed7680ca48164/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.949679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fecd12-4bc5-496b-8ff3-d367d1d15ae2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.954209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d51269-fd0c-4faa-90a1-e1c54760d6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:44.954870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d51269-fd0c-4faa-90a1-e1c54760d6fc admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:44.955218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d51269-fd0c-4faa-90a1-e1c54760d6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:44.955557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d51269-fd0c-4faa-90a1-e1c54760d6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:44.956260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d51269-fd0c-4faa-90a1-e1c54760d6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.957929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d51269-fd0c-4faa-90a1-e1c54760d6fc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.964782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a168b3-06b3-4400-a575-93ed4c0437d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed6e3e3c5994aac8ff1bfbb7f754000, user_id=e0589d6270464a4c8f5ed7680ca48164, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:44.967502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a168b3-06b3-4400-a575-93ed4c0437d4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:44.968004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 801/1602] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:44.968779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d51269-fd0c-4faa-90a1-e1c54760d6fc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:44.980216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d51269-fd0c-4faa-90a1-e1c54760d6fc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:44.983686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 802/1603] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:44 2022] PUT /identity/v3/projects/aed6e3e3c5994aac8ff1bfbb7f754000/users/e0589d6270464a4c8f5ed7680ca48164/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:44.983934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a168b3-06b3-4400-a575-93ed4c0437d4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.040554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9914c-c399-4884-ad2b-1d82b0f4df0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.041172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9914c-c399-4884-ad2b-1d82b0f4df0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.041456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9914c-c399-4884-ad2b-1d82b0f4df0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.041727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9914c-c399-4884-ad2b-1d82b0f4df0e admin admin] PATH_INFO: `/v3/projects/68d0920612044dcf9d23e21f9b2561d2/users/85869eddd2924f85a318e77184c5607b/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.044638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a168b3-06b3-4400-a575-93ed4c0437d4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.049480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df0352-a51e-4570-9164-6578d8091e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.050136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0352-a51e-4570-9164-6578d8091e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.050419 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0352-a51e-4570-9164-6578d8091e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.050696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0352-a51e-4570-9164-6578d8091e0b admin admin] PATH_INFO: `/v3/projects/5710ab1f531a42e7bcf6c0a7f5531bc0/users/4d8aff4a15834b52b8e7b7027c997333/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.056828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9914c-c399-4884-ad2b-1d82b0f4df0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d0920612044dcf9d23e21f9b2561d2, user_id=85869eddd2924f85a318e77184c5607b, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.059527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9914c-c399-4884-ad2b-1d82b0f4df0e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.065894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df0352-a51e-4570-9164-6578d8091e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5710ab1f531a42e7bcf6c0a7f5531bc0, user_id=4d8aff4a15834b52b8e7b7027c997333, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.068962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df0352-a51e-4570-9164-6578d8091e0b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.072837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 802/1604] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:44 2022] PUT /identity/v3/projects/68d0920612044dcf9d23e21f9b2561d2/users/85869eddd2924f85a318e77184c5607b/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:45.074078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0194e-e796-468e-89cf-d7340d7b220a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.074365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0194e-e796-468e-89cf-d7340d7b220a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.074643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0194e-e796-468e-89cf-d7340d7b220a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.086690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 803/1605] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:44 2022] PUT /identity/v3/projects/5710ab1f531a42e7bcf6c0a7f5531bc0/users/4d8aff4a15834b52b8e7b7027c997333/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:45.087930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b3bb-ee08-4235-a97b-494d911fedc6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.088223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b3bb-ee08-4235-a97b-494d911fedc6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.088495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b3bb-ee08-4235-a97b-494d911fedc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.118719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-54d2b3bb-ee08-4235-a97b-494d911fedc6 None None] MFA Rules not processed for user `7e88c48d013044d5b2fc270c74013872`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:45.119936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-54d2b3bb-ee08-4235-a97b-494d911fedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:45.121932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d3e0194e-e796-468e-89cf-d7340d7b220a None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:45.123212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d3e0194e-e796-468e-89cf-d7340d7b220a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:45.165723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:45.185114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 804/1606] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:45.186427 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f708114-a291-4738-89de-c1894ff8465f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.186716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f708114-a291-4738-89de-c1894ff8465f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.187014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f708114-a291-4738-89de-c1894ff8465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.196046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:45.196431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 803/1607] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:45.197918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0194e-e796-468e-89cf-d7340d7b220a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.217117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8f708114-a291-4738-89de-c1894ff8465f None None] MFA Rules not processed for user `cbfb851b4c0f4a02b6c67ac71883f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:45.218325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8f708114-a291-4738-89de-c1894ff8465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:45.253975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0194e-e796-468e-89cf-d7340d7b220a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.258026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e14eb-179b-4f01-aa46-80918b077871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.258635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e14eb-179b-4f01-aa46-80918b077871 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.258917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e14eb-179b-4f01-aa46-80918b077871 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.259190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e14eb-179b-4f01-aa46-80918b077871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.283403 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 805/1608] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:45.284352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f708114-a291-4738-89de-c1894ff8465f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.321591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e14eb-179b-4f01-aa46-80918b077871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.322942 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e14eb-179b-4f01-aa46-80918b077871 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.332639 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 804/1609] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:45.334427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6132dd-9415-4b56-83f9-e3024c13d52a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.334729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6132dd-9415-4b56-83f9-e3024c13d52a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.335018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6132dd-9415-4b56-83f9-e3024c13d52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.348053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f708114-a291-4738-89de-c1894ff8465f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.354661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e66f-e9ec-4c09-be3a-29f6e3888002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.355403 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e66f-e9ec-4c09-be3a-29f6e3888002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.355739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e66f-e9ec-4c09-be3a-29f6e3888002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.356065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e66f-e9ec-4c09-be3a-29f6e3888002 admin admin] PATH_INFO: `/v3/projects/4f2b5c30b896413abff90c2529a1d2ea/users/beee7ecbe9554a46a6be476aa5b2ef51/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.358267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2c6132dd-9415-4b56-83f9-e3024c13d52a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:45.359515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2c6132dd-9415-4b56-83f9-e3024c13d52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:45.369667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 805/1610] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:45.370921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446d714-1e7f-4f86-888a-4ec0b5f292df None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.371206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446d714-1e7f-4f86-888a-4ec0b5f292df None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.371482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446d714-1e7f-4f86-888a-4ec0b5f292df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.383579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491e66f-e9ec-4c09-be3a-29f6e3888002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2b5c30b896413abff90c2529a1d2ea, user_id=beee7ecbe9554a46a6be476aa5b2ef51, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.386455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491e66f-e9ec-4c09-be3a-29f6e3888002 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.391857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c446d714-1e7f-4f86-888a-4ec0b5f292df None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:45.393086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c446d714-1e7f-4f86-888a-4ec0b5f292df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:45.404865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 806/1611] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:45.404865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ea73-2107-4973-8b5d-56c6fc870a5f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.404865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ea73-2107-4973-8b5d-56c6fc870a5f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.404865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ea73-2107-4973-8b5d-56c6fc870a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.417446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 806/1612] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:45 2022] PUT /identity/v3/projects/4f2b5c30b896413abff90c2529a1d2ea/users/beee7ecbe9554a46a6be476aa5b2ef51/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:45.417446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e66f-e9ec-4c09-be3a-29f6e3888002 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.437175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-27a7ea73-2107-4973-8b5d-56c6fc870a5f None None] MFA Rules not processed for user `4d8aff4a15834b52b8e7b7027c997333`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:45.438908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-27a7ea73-2107-4973-8b5d-56c6fc870a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:45.494007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e66f-e9ec-4c09-be3a-29f6e3888002 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.499154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df895f3-68a9-40fc-a547-de9ca5b7675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.500370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df895f3-68a9-40fc-a547-de9ca5b7675d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.500675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df895f3-68a9-40fc-a547-de9ca5b7675d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.501056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df895f3-68a9-40fc-a547-de9ca5b7675d admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.501767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df895f3-68a9-40fc-a547-de9ca5b7675d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.503759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df895f3-68a9-40fc-a547-de9ca5b7675d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.517557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 807/1613] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:45.517557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7ea73-2107-4973-8b5d-56c6fc870a5f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.523289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:45.544745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 807/1614] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:45.549003 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df895f3-68a9-40fc-a547-de9ca5b7675d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.553585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:45.616643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7ea73-2107-4973-8b5d-56c6fc870a5f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.627272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df895f3-68a9-40fc-a547-de9ca5b7675d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.633943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9083b27-c75b-4ddc-aa97-f365580d0e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.634652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9083b27-c75b-4ddc-aa97-f365580d0e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.634929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9083b27-c75b-4ddc-aa97-f365580d0e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.635395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9083b27-c75b-4ddc-aa97-f365580d0e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.636075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9083b27-c75b-4ddc-aa97-f365580d0e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.638695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9083b27-c75b-4ddc-aa97-f365580d0e69 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.676872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 808/1615] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:45.680833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9083b27-c75b-4ddc-aa97-f365580d0e69 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.682517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a9083b27-c75b-4ddc-aa97-f365580d0e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:45.690011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c6057-7c60-41b2-88f4-8ebdcdb0287a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.691488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6057-7c60-41b2-88f4-8ebdcdb0287a service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.692189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6057-7c60-41b2-88f4-8ebdcdb0287a service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.692628 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6057-7c60-41b2-88f4-8ebdcdb0287a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.751566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9083b27-c75b-4ddc-aa97-f365580d0e69 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.759797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d33dfd-876c-4157-bce1-804452a74dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.760428 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d33dfd-876c-4157-bce1-804452a74dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.760709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d33dfd-876c-4157-bce1-804452a74dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.761119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d33dfd-876c-4157-bce1-804452a74dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.762034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c6057-7c60-41b2-88f4-8ebdcdb0287a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.764150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c6057-7c60-41b2-88f4-8ebdcdb0287a service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.781078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 808/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:45.782136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c6057-7c60-41b2-88f4-8ebdcdb0287a service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.848731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d33dfd-876c-4157-bce1-804452a74dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.851215 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d33dfd-876c-4157-bce1-804452a74dc8 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.852876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:45.864342 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 809/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:45.866455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890045d-47e4-4cdc-8856-cf9be0a596f8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.866825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890045d-47e4-4cdc-8856-cf9be0a596f8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.867451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890045d-47e4-4cdc-8856-cf9be0a596f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.872074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c6057-7c60-41b2-88f4-8ebdcdb0287a service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.876094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f530b1e-c140-407a-8279-a724a5000db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.877685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f530b1e-c140-407a-8279-a724a5000db8 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.877685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f530b1e-c140-407a-8279-a724a5000db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.877685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f530b1e-c140-407a-8279-a724a5000db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.888376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f530b1e-c140-407a-8279-a724a5000db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.890271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f530b1e-c140-407a-8279-a724a5000db8 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.891792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1890045d-47e4-4cdc-8856-cf9be0a596f8 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:45.893252 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1890045d-47e4-4cdc-8856-cf9be0a596f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:45.902836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 810/1618] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:45.903362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 809/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:45.903896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890045d-47e4-4cdc-8856-cf9be0a596f8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.904451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f530b1e-c140-407a-8279-a724a5000db8 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.916352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890045d-47e4-4cdc-8856-cf9be0a596f8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.923107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f530b1e-c140-407a-8279-a724a5000db8 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.924073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fcc3b-6526-4d77-a4e3-260540c741b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.924844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fcc3b-6526-4d77-a4e3-260540c741b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.925247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fcc3b-6526-4d77-a4e3-260540c741b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.925633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fcc3b-6526-4d77-a4e3-260540c741b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.926609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fcc3b-6526-4d77-a4e3-260540c741b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.929415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882657d-aa0b-42b0-b846-8c527eb9b823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:45.930117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fcc3b-6526-4d77-a4e3-260540c741b7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.930260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882657d-aa0b-42b0-b846-8c527eb9b823 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:45.930489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882657d-aa0b-42b0-b846-8c527eb9b823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:45.930831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882657d-aa0b-42b0-b846-8c527eb9b823 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:45.931522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882657d-aa0b-42b0-b846-8c527eb9b823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:45.933524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882657d-aa0b-42b0-b846-8c527eb9b823 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:45.961105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 810/1620] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/users => generated 297 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:45.961925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882657d-aa0b-42b0-b846-8c527eb9b823 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.970108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 811/1621] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:45.970108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fcc3b-6526-4d77-a4e3-260540c741b7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:45.973843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882657d-aa0b-42b0-b846-8c527eb9b823 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:45.982792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:46.052178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fcc3b-6526-4d77-a4e3-260540c741b7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.058486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d88d4-1aec-43fd-8e07-0a637b37b687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.059219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d88d4-1aec-43fd-8e07-0a637b37b687 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.059479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d88d4-1aec-43fd-8e07-0a637b37b687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.059737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d88d4-1aec-43fd-8e07-0a637b37b687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.067049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2bb93-b532-4a18-826b-9d879cc20d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.068130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2bb93-b532-4a18-826b-9d879cc20d35 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.068649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2bb93-b532-4a18-826b-9d879cc20d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.069181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2bb93-b532-4a18-826b-9d879cc20d35 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.070101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2bb93-b532-4a18-826b-9d879cc20d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.073691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2bb93-b532-4a18-826b-9d879cc20d35 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.106780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 811/1622] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:45 2022] POST /identity/v3/users => generated 309 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:46.108372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2bb93-b532-4a18-826b-9d879cc20d35 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.122435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2bb93-b532-4a18-826b-9d879cc20d35 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.131259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa92355-43cc-4e16-b0b5-5946819fdf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.135130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa92355-43cc-4e16-b0b5-5946819fdf98 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.135418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa92355-43cc-4e16-b0b5-5946819fdf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.135688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa92355-43cc-4e16-b0b5-5946819fdf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.136341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa92355-43cc-4e16-b0b5-5946819fdf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.137958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa92355-43cc-4e16-b0b5-5946819fdf98 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.143413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d88d4-1aec-43fd-8e07-0a637b37b687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.144851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d88d4-1aec-43fd-8e07-0a637b37b687 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.155421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 812/1623] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:46.156341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d88d4-1aec-43fd-8e07-0a637b37b687 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.158715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 812/1624] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:46.161601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa92355-43cc-4e16-b0b5-5946819fdf98 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.166478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d88d4-1aec-43fd-8e07-0a637b37b687 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.171857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a7593-5f6d-492a-9bdb-fb80084384a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.172631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a7593-5f6d-492a-9bdb-fb80084384a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.173091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a7593-5f6d-492a-9bdb-fb80084384a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.173223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a7593-5f6d-492a-9bdb-fb80084384a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.173961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a7593-5f6d-492a-9bdb-fb80084384a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.175900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a7593-5f6d-492a-9bdb-fb80084384a4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.186831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa92355-43cc-4e16-b0b5-5946819fdf98 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.197053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979773e7-dce7-49d1-8a5f-c2436128e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.197674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979773e7-dce7-49d1-8a5f-c2436128e457 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.197956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979773e7-dce7-49d1-8a5f-c2436128e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.198233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979773e7-dce7-49d1-8a5f-c2436128e457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.198879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979773e7-dce7-49d1-8a5f-c2436128e457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.200499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979773e7-dce7-49d1-8a5f-c2436128e457 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.207072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 813/1625] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:46 2022] POST /identity/v3/users => generated 292 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:46.207880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a7593-5f6d-492a-9bdb-fb80084384a4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.222740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a7593-5f6d-492a-9bdb-fb80084384a4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.226451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 813/1626] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:46.227293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979773e7-dce7-49d1-8a5f-c2436128e457 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.233950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd645b-eda7-455a-a7eb-c7a540ac8fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.234691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd645b-eda7-455a-a7eb-c7a540ac8fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.235044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd645b-eda7-455a-a7eb-c7a540ac8fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.235392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd645b-eda7-455a-a7eb-c7a540ac8fd3 admin admin] PATH_INFO: `/v3/projects/374f15e2cd674cd38b96edc5fd858062/users/a87e7454656b4568be23aac694f457a8/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.244966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979773e7-dce7-49d1-8a5f-c2436128e457 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.252648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd645b-eda7-455a-a7eb-c7a540ac8fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374f15e2cd674cd38b96edc5fd858062, user_id=a87e7454656b4568be23aac694f457a8, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.253138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad934f10-6c69-4222-974a-693afd9e25f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.254875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad934f10-6c69-4222-974a-693afd9e25f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.255078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad934f10-6c69-4222-974a-693afd9e25f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.256044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad934f10-6c69-4222-974a-693afd9e25f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.256173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd645b-eda7-455a-a7eb-c7a540ac8fd3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.257174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad934f10-6c69-4222-974a-693afd9e25f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.259449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad934f10-6c69-4222-974a-693afd9e25f7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.279706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 814/1627] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:46 2022] PUT /identity/v3/projects/374f15e2cd674cd38b96edc5fd858062/users/a87e7454656b4568be23aac694f457a8/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:46.279706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd645b-eda7-455a-a7eb-c7a540ac8fd3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.283757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 814/1628] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:46.285364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad934f10-6c69-4222-974a-693afd9e25f7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.308226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad934f10-6c69-4222-974a-693afd9e25f7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.409013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd645b-eda7-455a-a7eb-c7a540ac8fd3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.422908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c86201-5711-4a1c-9339-fdf178632502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.423683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86201-5711-4a1c-9339-fdf178632502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.424024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86201-5711-4a1c-9339-fdf178632502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.424576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86201-5711-4a1c-9339-fdf178632502 admin admin] PATH_INFO: `/v3/projects/a510d908abd040c1be210246a1e47a20/users/08d5ab088ff24d19bec8ec77997ac05e/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.426063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfa5a9-7222-4aaa-8f31-3bf756a3e674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.427068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfa5a9-7222-4aaa-8f31-3bf756a3e674 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.428054 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfa5a9-7222-4aaa-8f31-3bf756a3e674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.428580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfa5a9-7222-4aaa-8f31-3bf756a3e674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.430546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfa5a9-7222-4aaa-8f31-3bf756a3e674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.432823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfa5a9-7222-4aaa-8f31-3bf756a3e674 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.451385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 815/1629] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:46.451385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfa5a9-7222-4aaa-8f31-3bf756a3e674 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.453298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c86201-5711-4a1c-9339-fdf178632502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a510d908abd040c1be210246a1e47a20, user_id=08d5ab088ff24d19bec8ec77997ac05e, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.456239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c86201-5711-4a1c-9339-fdf178632502 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.466775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfa5a9-7222-4aaa-8f31-3bf756a3e674 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.476800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c318ad-3b52-4093-b5a4-53b9d1c9e71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.476800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c318ad-3b52-4093-b5a4-53b9d1c9e71c admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.476800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c318ad-3b52-4093-b5a4-53b9d1c9e71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.476800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c318ad-3b52-4093-b5a4-53b9d1c9e71c admin admin] PATH_INFO: `/v3/projects/8cd3cba156024d9eb786d21ba243518b/users/314fc93483574816a66ba7632c895ac2/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.483466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:46.488435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 815/1630] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:46 2022] PUT /identity/v3/projects/a510d908abd040c1be210246a1e47a20/users/08d5ab088ff24d19bec8ec77997ac05e/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:46.501831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c86201-5711-4a1c-9339-fdf178632502 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.522632 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:46.531198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c318ad-3b52-4093-b5a4-53b9d1c9e71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd3cba156024d9eb786d21ba243518b, user_id=314fc93483574816a66ba7632c895ac2, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.538969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c318ad-3b52-4093-b5a4-53b9d1c9e71c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.592627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 816/1631] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:46 2022] PUT /identity/v3/projects/8cd3cba156024d9eb786d21ba243518b/users/314fc93483574816a66ba7632c895ac2/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:46.593786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c318ad-3b52-4093-b5a4-53b9d1c9e71c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.647151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c86201-5711-4a1c-9339-fdf178632502 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.676529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c318ad-3b52-4093-b5a4-53b9d1c9e71c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.685218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624476b-2e01-4478-8148-92a2481669ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.686104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624476b-2e01-4478-8148-92a2481669ad admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.687810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624476b-2e01-4478-8148-92a2481669ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.688241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624476b-2e01-4478-8148-92a2481669ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.689098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624476b-2e01-4478-8148-92a2481669ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.692156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624476b-2e01-4478-8148-92a2481669ad admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.712610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 817/1632] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:46.712610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada86e7-822a-42c0-921f-2d8e317cd901 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.712610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada86e7-822a-42c0-921f-2d8e317cd901 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.712610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada86e7-822a-42c0-921f-2d8e317cd901 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.713528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 818/1633] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 10:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:32:46.714759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada86e7-822a-42c0-921f-2d8e317cd901 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.732411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada86e7-822a-42c0-921f-2d8e317cd901 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.740254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c9c2e-503f-4ce6-83a3-5af2c743a011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.741290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c9c2e-503f-4ce6-83a3-5af2c743a011 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.741674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c9c2e-503f-4ce6-83a3-5af2c743a011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.742898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c9c2e-503f-4ce6-83a3-5af2c743a011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.742898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c9c2e-503f-4ce6-83a3-5af2c743a011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.745207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c9c2e-503f-4ce6-83a3-5af2c743a011 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.758124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 819/1634] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:46.759461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c9c2e-503f-4ce6-83a3-5af2c743a011 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.772230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c9c2e-503f-4ce6-83a3-5af2c743a011 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.779640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aa001-863a-4924-bfc2-5f89a36845c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.780742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa001-863a-4924-bfc2-5f89a36845c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.781104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa001-863a-4924-bfc2-5f89a36845c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.781529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aa001-863a-4924-bfc2-5f89a36845c0 admin admin] PATH_INFO: `/v3/projects/a510d908abd040c1be210246a1e47a20/users/08d5ab088ff24d19bec8ec77997ac05e/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.784365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa001-863a-4924-bfc2-5f89a36845c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a510d908abd040c1be210246a1e47a20, user_id=08d5ab088ff24d19bec8ec77997ac05e, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.788678 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aa001-863a-4924-bfc2-5f89a36845c0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.811836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 820/1635] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:46 2022] PUT /identity/v3/projects/a510d908abd040c1be210246a1e47a20/users/08d5ab088ff24d19bec8ec77997ac05e/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:46.813703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303f66a-f536-4aa6-b039-2bcf1096145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.814387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303f66a-f536-4aa6-b039-2bcf1096145a admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.814612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1781ae-16ac-4c99-af8e-2673245e3f2e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.814733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303f66a-f536-4aa6-b039-2bcf1096145a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.814928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303f66a-f536-4aa6-b039-2bcf1096145a admin admin] PATH_INFO: `/v3/projects/374f15e2cd674cd38b96edc5fd858062/users/a87e7454656b4568be23aac694f457a8/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.815206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1781ae-16ac-4c99-af8e-2673245e3f2e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.815620 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1781ae-16ac-4c99-af8e-2673245e3f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.821463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303f66a-f536-4aa6-b039-2bcf1096145a admin admin] RBAC: Authorizing `identity:create_grant(project_id=374f15e2cd674cd38b96edc5fd858062, user_id=a87e7454656b4568be23aac694f457a8, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.824901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303f66a-f536-4aa6-b039-2bcf1096145a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.851084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1f1781ae-16ac-4c99-af8e-2673245e3f2e None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:46.851860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 816/1636] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:46 2022] PUT /identity/v3/projects/374f15e2cd674cd38b96edc5fd858062/users/a87e7454656b4568be23aac694f457a8/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:46.852722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303f66a-f536-4aa6-b039-2bcf1096145a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:46.853411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1f1781ae-16ac-4c99-af8e-2673245e3f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:46.953895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303f66a-f536-4aa6-b039-2bcf1096145a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:46.960812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d578-250b-42de-8df6-cb4a0f00f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:46.961992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d578-250b-42de-8df6-cb4a0f00f88b admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.962123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d578-250b-42de-8df6-cb4a0f00f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.962369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d578-250b-42de-8df6-cb4a0f00f88b admin admin] PATH_INFO: `/v3/projects/8cd3cba156024d9eb786d21ba243518b/users/314fc93483574816a66ba7632c895ac2/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.964548 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d578-250b-42de-8df6-cb4a0f00f88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd3cba156024d9eb786d21ba243518b, user_id=314fc93483574816a66ba7632c895ac2, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:46.967644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d578-250b-42de-8df6-cb4a0f00f88b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:46.977276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 821/1637] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:46.980257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea365ee-4027-414f-8ead-0c4caebc019d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:46.980693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea365ee-4027-414f-8ead-0c4caebc019d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:46.981148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea365ee-4027-414f-8ead-0c4caebc019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:46.999708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 817/1638] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:46 2022] PUT /identity/v3/projects/8cd3cba156024d9eb786d21ba243518b/users/314fc93483574816a66ba7632c895ac2/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:47.001181 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0744d-7d6f-4401-af03-2c3a46e487a8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:47.001632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0744d-7d6f-4401-af03-2c3a46e487a8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:47.002078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0744d-7d6f-4401-af03-2c3a46e487a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:47.032090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0ea365ee-4027-414f-8ead-0c4caebc019d None None] MFA Rules not processed for user `08d5ab088ff24d19bec8ec77997ac05e`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:47.034802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0ea365ee-4027-414f-8ead-0c4caebc019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:47.045531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-51f0744d-7d6f-4401-af03-2c3a46e487a8 None None] MFA Rules not processed for user `a87e7454656b4568be23aac694f457a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:47.047395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-51f0744d-7d6f-4401-af03-2c3a46e487a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:47.089635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:47.112055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:47.164290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 822/1639] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:47.166335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec4da8-1ede-447c-bb6f-f97d8a028cd2 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:47.167256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec4da8-1ede-447c-bb6f-f97d8a028cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:47.167535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec4da8-1ede-447c-bb6f-f97d8a028cd2 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:47.169323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 823/1640] 10.222.0.18 () {54 vars in 912 bytes} [Mon Sep 26 10:32:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:32:47.170996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748a5db-0eaa-484c-b08a-a5ed6f68f661 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:47.170996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748a5db-0eaa-484c-b08a-a5ed6f68f661 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:47.171194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748a5db-0eaa-484c-b08a-a5ed6f68f661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:47.199247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 818/1641] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:47.201812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275b602-96fc-446d-bcc5-d7c6cf4005fc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:47.202383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275b602-96fc-446d-bcc5-d7c6cf4005fc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:47.202879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275b602-96fc-446d-bcc5-d7c6cf4005fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:47.244232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b748a5db-0eaa-484c-b08a-a5ed6f68f661 None None] MFA Rules not processed for user `314fc93483574816a66ba7632c895ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:47.248554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b748a5db-0eaa-484c-b08a-a5ed6f68f661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:47.262668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5275b602-96fc-446d-bcc5-d7c6cf4005fc None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:47.267554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5275b602-96fc-446d-bcc5-d7c6cf4005fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:47.436754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 819/1642] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:32:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:47.437919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275b602-96fc-446d-bcc5-d7c6cf4005fc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:47.452858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 824/1643] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:47.459530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748a5db-0eaa-484c-b08a-a5ed6f68f661 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:47.572342 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275b602-96fc-446d-bcc5-d7c6cf4005fc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:47.581532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ee8d6-4989-401c-880a-49adc97ae783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:47.582420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ee8d6-4989-401c-880a-49adc97ae783 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:47.582696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ee8d6-4989-401c-880a-49adc97ae783 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:47.583031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ee8d6-4989-401c-880a-49adc97ae783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:47.611517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ee8d6-4989-401c-880a-49adc97ae783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:47.613574 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ee8d6-4989-401c-880a-49adc97ae783 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:47.626014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748a5db-0eaa-484c-b08a-a5ed6f68f661 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:47.635965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcfa96-2fcf-4b45-b92a-4b19aaa610e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:47.636605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcfa96-2fcf-4b45-b92a-4b19aaa610e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:47.636967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcfa96-2fcf-4b45-b92a-4b19aaa610e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:47.637268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcfa96-2fcf-4b45-b92a-4b19aaa610e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:47.647528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 820/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:47 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:47.650137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcfa96-2fcf-4b45-b92a-4b19aaa610e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:47.652703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcfa96-2fcf-4b45-b92a-4b19aaa610e6 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:47.672469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 825/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:47.736366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ee8d6-4989-401c-880a-49adc97ae783 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:47.747199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ee8d6-4989-401c-880a-49adc97ae783 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:47.751744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d67c8f-b708-45ff-b8b8-3b22ba790c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:47.753191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d67c8f-b708-45ff-b8b8-3b22ba790c19 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:47.753696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d67c8f-b708-45ff-b8b8-3b22ba790c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:47.754199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d67c8f-b708-45ff-b8b8-3b22ba790c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:47.769794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d67c8f-b708-45ff-b8b8-3b22ba790c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:47.782964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcfa96-2fcf-4b45-b92a-4b19aaa610e6 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:47.795256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d67c8f-b708-45ff-b8b8-3b22ba790c19 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:47.796990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcfa96-2fcf-4b45-b92a-4b19aaa610e6 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:47.806279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a3755-6c9a-4616-bd26-62ca69d7dc46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:47.806993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3755-6c9a-4616-bd26-62ca69d7dc46 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:47.807346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3755-6c9a-4616-bd26-62ca69d7dc46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:47.808006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3755-6c9a-4616-bd26-62ca69d7dc46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:47.845038 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 821/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:47.847931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a3755-6c9a-4616-bd26-62ca69d7dc46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:47.850814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a3755-6c9a-4616-bd26-62ca69d7dc46 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:47.878586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 826/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:32:48.062044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca6243-1507-40de-9cbe-536746eeafc9 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:48.062429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca6243-1507-40de-9cbe-536746eeafc9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:48.062589 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca6243-1507-40de-9cbe-536746eeafc9 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:48.064112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 822/1648] 10.222.0.18 () {54 vars in 912 bytes} [Mon Sep 26 10:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:32:48.073983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a3755-6c9a-4616-bd26-62ca69d7dc46 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:48.081560 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1352-36d0-4e52-ad75-bf9305097892 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:48.082140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1352-36d0-4e52-ad75-bf9305097892 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:48.084281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1352-36d0-4e52-ad75-bf9305097892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:48.090492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a3755-6c9a-4616-bd26-62ca69d7dc46 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:48.101409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c465e63-1fdb-4806-9f89-ca986d7c5fa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:48.102028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c465e63-1fdb-4806-9f89-ca986d7c5fa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:48.102314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c465e63-1fdb-4806-9f89-ca986d7c5fa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:48.102588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c465e63-1fdb-4806-9f89-ca986d7c5fa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:48.129532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bf9b1352-36d0-4e52-ad75-bf9305097892 None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:48.132002 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bf9b1352-36d0-4e52-ad75-bf9305097892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:48.165747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 823/1649] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:32:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:48.169252 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1352-36d0-4e52-ad75-bf9305097892 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:48.185647 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1352-36d0-4e52-ad75-bf9305097892 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:48.198103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b229d-b27b-4582-b98b-21a7f072db99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:48.201863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b229d-b27b-4582-b98b-21a7f072db99 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:48.202591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b229d-b27b-4582-b98b-21a7f072db99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:48.202871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b229d-b27b-4582-b98b-21a7f072db99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:48.262315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:48.277515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c465e63-1fdb-4806-9f89-ca986d7c5fa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:48.282240 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:48.287676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c465e63-1fdb-4806-9f89-ca986d7c5fa7 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:48.309373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 827/1650] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:48.329303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b229d-b27b-4582-b98b-21a7f072db99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:48.330964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b229d-b27b-4582-b98b-21a7f072db99 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:48.357793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 824/1651] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:48.591205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c465e63-1fdb-4806-9f89-ca986d7c5fa7 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:48.592937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b229d-b27b-4582-b98b-21a7f072db99 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:48.637275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b229d-b27b-4582-b98b-21a7f072db99 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:48.652912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccd2dd-b9de-4dd4-84e0-99a7f8eebc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:48.653613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccd2dd-b9de-4dd4-84e0-99a7f8eebc19 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:48.654438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccd2dd-b9de-4dd4-84e0-99a7f8eebc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:48.655728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccd2dd-b9de-4dd4-84e0-99a7f8eebc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:48.719408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccd2dd-b9de-4dd4-84e0-99a7f8eebc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:48.720989 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccd2dd-b9de-4dd4-84e0-99a7f8eebc19 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:48.781397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 825/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:48.843566 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c465e63-1fdb-4806-9f89-ca986d7c5fa7 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:48.848896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:48.850194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:48.850455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:48.850761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] PATH_INFO: `/v3/users/cbfb851b4c0f4a02b6c67ac71883f27c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:48.852980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbfb851b4c0f4a02b6c67ac71883f27c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:48.860574 dv-cinder-844563-7-smb devstack@keystone.service[81436]: WARNING py.warnings [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:32:48.860574 dv-cinder-844563-7-smb devstack@keystone.service[81436]: warnings.warn(msg) Sep 26 10:32:48.860574 dv-cinder-844563-7-smb devstack@keystone.service[81436]: Sep 26 10:32:48.860574 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:48.919084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccd2dd-b9de-4dd4-84e0-99a7f8eebc19 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:48.935469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccd2dd-b9de-4dd4-84e0-99a7f8eebc19 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:48.947280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:48.947936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:48.948218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:48.988466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] PATH_INFO: `/v3/users/632e917894ac4305ab441182dc9dad74` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:48.988466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=632e917894ac4305ab441182dc9dad74)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:48.988466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:48.995677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfb851b4c0f4a02b6c67ac71883f27c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:48.995677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfb851b4c0f4a02b6c67ac71883f27c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:49.028816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfb851b4c0f4a02b6c67ac71883f27c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:49.071124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfb851b4c0f4a02b6c67ac71883f27c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:49.072375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c1d65598-bc32-4a5a-85fe-2b760600ebf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfb851b4c0f4a02b6c67ac71883f27c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:49.081321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632e917894ac4305ab441182dc9dad74'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:49.096194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632e917894ac4305ab441182dc9dad74'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:49.097519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632e917894ac4305ab441182dc9dad74'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:49.103418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 828/1653] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:32:48 2022] DELETE /identity/v3/users/cbfb851b4c0f4a02b6c67ac71883f27c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:49.109467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632e917894ac4305ab441182dc9dad74'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:49.109722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72110176-fe3a-4187-b91b-49558193e78c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:49.110120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72110176-fe3a-4187-b91b-49558193e78c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:49.110499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72110176-fe3a-4187-b91b-49558193e78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:49.134956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-72110176-fe3a-4187-b91b-49558193e78c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:49.136975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-72110176-fe3a-4187-b91b-49558193e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:49.149757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-465ce817-8e1f-4b98-84bf-45b283a88589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632e917894ac4305ab441182dc9dad74'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:49.166522 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 826/1654] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:32:48 2022] DELETE /identity/v3/users/632e917894ac4305ab441182dc9dad74 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:49.172320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ad74-ebe6-447e-9244-a151a2ad6c49 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:49.172777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ad74-ebe6-447e-9244-a151a2ad6c49 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:49.173268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ad74-ebe6-447e-9244-a151a2ad6c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:49.207459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-56c7ad74-ebe6-447e-9244-a151a2ad6c49 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:49.211068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-56c7ad74-ebe6-447e-9244-a151a2ad6c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:49.304044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 829/1655] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:49.313544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 827/1656] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:32:49.329098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72110176-fe3a-4187-b91b-49558193e78c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:49.331030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-72110176-fe3a-4187-b91b-49558193e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:49.337397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ad74-ebe6-447e-9244-a151a2ad6c49 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:49.339725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-56c7ad74-ebe6-447e-9244-a151a2ad6c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:49.355381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:49.429716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:49.439087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72110176-fe3a-4187-b91b-49558193e78c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:49.494201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ad74-ebe6-447e-9244-a151a2ad6c49 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:49.503635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e26626-07c9-4c03-9383-cdd610bc5880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:49.504719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e26626-07c9-4c03-9383-cdd610bc5880 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:49.505061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e26626-07c9-4c03-9383-cdd610bc5880 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:49.505298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e26626-07c9-4c03-9383-cdd610bc5880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:49.527111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e26626-07c9-4c03-9383-cdd610bc5880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:49.528570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e26626-07c9-4c03-9383-cdd610bc5880 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:49.536416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71397beb-a573-4059-90f9-505cb9a22400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:49.537596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71397beb-a573-4059-90f9-505cb9a22400 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:49.537877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71397beb-a573-4059-90f9-505cb9a22400 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:49.538144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71397beb-a573-4059-90f9-505cb9a22400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:49.552298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 828/1657] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:32:49.554531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71397beb-a573-4059-90f9-505cb9a22400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:49.555984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71397beb-a573-4059-90f9-505cb9a22400 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:49.568819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 830/1658] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:32:51.679592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e26626-07c9-4c03-9383-cdd610bc5880 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:51.681066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-86e26626-07c9-4c03-9383-cdd610bc5880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:51.707672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e26626-07c9-4c03-9383-cdd610bc5880 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:51.714518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:51.715568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:51.716119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:51.716614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] PATH_INFO: `/v3/projects/f754d7d9134742749850328b574451e8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:51.718166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f754d7d9134742749850328b574451e8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:51.719469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: WARNING py.warnings [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 10:32:51.719469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: warnings.warn(msg) Sep 26 10:32:51.719469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: Sep 26 10:32:51.721328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:51.776040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71397beb-a573-4059-90f9-505cb9a22400 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:51.777812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-71397beb-a573-4059-90f9-505cb9a22400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:51.798291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71397beb-a573-4059-90f9-505cb9a22400 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:51.806411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f754d7d9134742749850328b574451e8', 'request_id': 'req-cf18be5f-af4b-49a9-bcc5-286faf66be5a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:51.825432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f754d7d9134742749850328b574451e8', 'request_id': 'req-cf18be5f-af4b-49a9-bcc5-286faf66be5a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:51.837619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f754d7d9134742749850328b574451e8', 'request_id': 'req-cf18be5f-af4b-49a9-bcc5-286faf66be5a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:51.863893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] The token cache is being invalidate because project f754d7d9134742749850328b574451e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:32:51.864348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:51.871645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:51.874002 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 829/1659] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:32:51 2022] DELETE /identity/v3/projects/f754d7d9134742749850328b574451e8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:51.881901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:51.883424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:51.946754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:51.947407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:51.947686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:51.947958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] PATH_INFO: `/v3/projects/e7f0397f30c44ace99903e9f3fe2d2ed` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:51.951760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f0397f30c44ace99903e9f3fe2d2ed)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:51.953747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:52.082344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f0397f30c44ace99903e9f3fe2d2ed', 'request_id': 'req-0ccdccf0-065e-4511-a76e-a3b63404153f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:52.091662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f0397f30c44ace99903e9f3fe2d2ed', 'request_id': 'req-0ccdccf0-065e-4511-a76e-a3b63404153f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:52.103259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f0397f30c44ace99903e9f3fe2d2ed', 'request_id': 'req-0ccdccf0-065e-4511-a76e-a3b63404153f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:52.129734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] The token cache is being invalidate because project e7f0397f30c44ace99903e9f3fe2d2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:32:52.130680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:52.133624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ccdccf0-065e-4511-a76e-a3b63404153f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:52.140290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18be5f-af4b-49a9-bcc5-286faf66be5a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:52.142448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 831/1660] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:32:51 2022] DELETE /identity/v3/projects/e7f0397f30c44ace99903e9f3fe2d2ed => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:32:52.143910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e561d6-d4a8-4038-9a81-50cc08d3e547 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:52.144085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e561d6-d4a8-4038-9a81-50cc08d3e547 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:52.144353 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e561d6-d4a8-4038-9a81-50cc08d3e547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:52.166732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:52.196569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-33e561d6-d4a8-4038-9a81-50cc08d3e547 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:52.197772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-33e561d6-d4a8-4038-9a81-50cc08d3e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:52.441892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:52.448827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:52.450356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:52.450658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] PATH_INFO: `/v3/users/08d5ab088ff24d19bec8ec77997ac05e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:52.456922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 832/1661] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:52.462924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d5ab088ff24d19bec8ec77997ac05e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:52.465393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39865c-d67e-4473-a37b-6a0aaef1da47 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:52.465803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39865c-d67e-4473-a37b-6a0aaef1da47 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:52.466012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39865c-d67e-4473-a37b-6a0aaef1da47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:52.490758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:52.512882 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:52.574839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6a39865c-d67e-4473-a37b-6a0aaef1da47 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:52.578580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6a39865c-d67e-4473-a37b-6a0aaef1da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:52.617682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 833/1662] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:52.621899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39865c-d67e-4473-a37b-6a0aaef1da47 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:52.656137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39865c-d67e-4473-a37b-6a0aaef1da47 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:52.680704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8854-274f-46ce-b8af-7c52b96e7e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:52.683189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8854-274f-46ce-b8af-7c52b96e7e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:52.684616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8854-274f-46ce-b8af-7c52b96e7e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:52.685335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8854-274f-46ce-b8af-7c52b96e7e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:52.691243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf8854-274f-46ce-b8af-7c52b96e7e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:32:52.691894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf8854-274f-46ce-b8af-7c52b96e7e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:52.696912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d5ab088ff24d19bec8ec77997ac05e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:52.697993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf8854-274f-46ce-b8af-7c52b96e7e69 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:52.723662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d5ab088ff24d19bec8ec77997ac05e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:52.725401 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d5ab088ff24d19bec8ec77997ac05e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:52.737997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 834/1663] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:32:52.742001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8854-274f-46ce-b8af-7c52b96e7e69 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:52.743776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d5ab088ff24d19bec8ec77997ac05e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:52.746048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-edbf8854-274f-46ce-b8af-7c52b96e7e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:52.785412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8854-274f-46ce-b8af-7c52b96e7e69 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:52.786744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d5ab088ff24d19bec8ec77997ac05e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:52.818377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7f59f-7a5d-429f-9be8-6d5c06ceed35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:52.823268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7f59f-7a5d-429f-9be8-6d5c06ceed35 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:52.824151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7f59f-7a5d-429f-9be8-6d5c06ceed35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:52.824724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 830/1664] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:32:51 2022] DELETE /identity/v3/users/08d5ab088ff24d19bec8ec77997ac05e => generated 0 bytes in 943 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:52.825984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7f59f-7a5d-429f-9be8-6d5c06ceed35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:52.827664 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7f59f-7a5d-429f-9be8-6d5c06ceed35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:52.831211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7f59f-7a5d-429f-9be8-6d5c06ceed35 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:52.961579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 835/1665] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:52 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:52.965992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:53.230628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac13691-9c62-4de6-93c5-54806c371578 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:53.340022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e440aa8-d4d8-4878-b688-1638b6a3a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:53.340863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e440aa8-d4d8-4878-b688-1638b6a3a641 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:53.341669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e440aa8-d4d8-4878-b688-1638b6a3a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:53.342055 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e440aa8-d4d8-4878-b688-1638b6a3a641 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:53.343036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e440aa8-d4d8-4878-b688-1638b6a3a641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:53.346326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e440aa8-d4d8-4878-b688-1638b6a3a641 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:53.392573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 831/1666] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:52 2022] POST /identity/v3/users => generated 302 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:53.399924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7f59f-7a5d-429f-9be8-6d5c06ceed35 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:53.418599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7f59f-7a5d-429f-9be8-6d5c06ceed35 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:53.435238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75837b-2a6d-41ff-ac0e-2fbc5745e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:53.440609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75837b-2a6d-41ff-ac0e-2fbc5745e9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:53.442656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75837b-2a6d-41ff-ac0e-2fbc5745e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:53.443142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75837b-2a6d-41ff-ac0e-2fbc5745e9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:53.444095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75837b-2a6d-41ff-ac0e-2fbc5745e9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:53.449449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75837b-2a6d-41ff-ac0e-2fbc5745e9c0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:53.495058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 836/1667] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:53.499515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e440aa8-d4d8-4878-b688-1638b6a3a641 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:53.516599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e440aa8-d4d8-4878-b688-1638b6a3a641 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:53.529884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e30490-7bd2-4a08-be81-81b53efcb9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:53.530633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e30490-7bd2-4a08-be81-81b53efcb9aa admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:53.530986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e30490-7bd2-4a08-be81-81b53efcb9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:53.531356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e30490-7bd2-4a08-be81-81b53efcb9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:53.532092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e30490-7bd2-4a08-be81-81b53efcb9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:53.533994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e30490-7bd2-4a08-be81-81b53efcb9aa admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:53.563282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75837b-2a6d-41ff-ac0e-2fbc5745e9c0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:53.563999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 832/1668] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:53.584633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75837b-2a6d-41ff-ac0e-2fbc5745e9c0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:53.599078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c41fbd-fabd-4a6d-9d4b-4a77590662d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:53.602627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c41fbd-fabd-4a6d-9d4b-4a77590662d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:53.604453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c41fbd-fabd-4a6d-9d4b-4a77590662d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:53.605257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c41fbd-fabd-4a6d-9d4b-4a77590662d1 admin admin] PATH_INFO: `/v3/projects/a2c9b273836b4a10b3ce86f475fd1c3d/users/a90756c9ba9541ffb3240b18af2e71c3/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:53.668493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c41fbd-fabd-4a6d-9d4b-4a77590662d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c9b273836b4a10b3ce86f475fd1c3d, user_id=a90756c9ba9541ffb3240b18af2e71c3, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:53.671354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c41fbd-fabd-4a6d-9d4b-4a77590662d1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:53.698399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 837/1669] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:53 2022] PUT /identity/v3/projects/a2c9b273836b4a10b3ce86f475fd1c3d/users/a90756c9ba9541ffb3240b18af2e71c3/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:53.703574 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d587431-b9b3-4b8e-b066-47981ba009d0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:53.704427 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d587431-b9b3-4b8e-b066-47981ba009d0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:53.704888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d587431-b9b3-4b8e-b066-47981ba009d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:53.744170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7d587431-b9b3-4b8e-b066-47981ba009d0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:53.746529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7d587431-b9b3-4b8e-b066-47981ba009d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:53.764279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:53.920891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 833/1670] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:54.209481 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c41fbd-fabd-4a6d-9d4b-4a77590662d1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:54.211825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-45c41fbd-fabd-4a6d-9d4b-4a77590662d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:54.330034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c41fbd-fabd-4a6d-9d4b-4a77590662d1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:54.341391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f598f2e-0638-45d9-a298-2ee935d89810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:54.342342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598f2e-0638-45d9-a298-2ee935d89810 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:54.342342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598f2e-0638-45d9-a298-2ee935d89810 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:54.342550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598f2e-0638-45d9-a298-2ee935d89810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:54.360335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f598f2e-0638-45d9-a298-2ee935d89810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:54.361806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f598f2e-0638-45d9-a298-2ee935d89810 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:54.386304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 838/1671] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:32:56.194980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d587431-b9b3-4b8e-b066-47981ba009d0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:56.196256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7d587431-b9b3-4b8e-b066-47981ba009d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:56.223189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d587431-b9b3-4b8e-b066-47981ba009d0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:56.245841 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:56.246508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:56.246793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:56.249442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] PATH_INFO: `/v3/projects/a510d908abd040c1be210246a1e47a20` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:56.256050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a510d908abd040c1be210246a1e47a20)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:56.259368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:56.419947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a510d908abd040c1be210246a1e47a20', 'request_id': 'req-c5a00306-0382-43b9-bbde-65d0080160bb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:56.436875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a510d908abd040c1be210246a1e47a20', 'request_id': 'req-c5a00306-0382-43b9-bbde-65d0080160bb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:56.451009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a510d908abd040c1be210246a1e47a20', 'request_id': 'req-c5a00306-0382-43b9-bbde-65d0080160bb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:56.477960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] The token cache is being invalidate because project a510d908abd040c1be210246a1e47a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:32:56.478261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:56.479000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c5a00306-0382-43b9-bbde-65d0080160bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:32:56.482138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 834/1672] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:32:56 2022] DELETE /identity/v3/projects/a510d908abd040c1be210246a1e47a20 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:56.488008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27518a-9f39-43c2-86c5-7cc60d669890 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:56.489014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27518a-9f39-43c2-86c5-7cc60d669890 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:56.489494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27518a-9f39-43c2-86c5-7cc60d669890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:56.570210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9c27518a-9f39-43c2-86c5-7cc60d669890 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:56.573413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9c27518a-9f39-43c2-86c5-7cc60d669890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:56.630660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:56.766050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 839/1673] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:56.776161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffb6f7-148f-43cf-a015-445b54872d1f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:56.776505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffb6f7-148f-43cf-a015-445b54872d1f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:56.776814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffb6f7-148f-43cf-a015-445b54872d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:56.824700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-70ffb6f7-148f-43cf-a015-445b54872d1f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:56.825974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-70ffb6f7-148f-43cf-a015-445b54872d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:56.907010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 835/1674] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:56.910345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27518a-9f39-43c2-86c5-7cc60d669890 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:56.930441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27518a-9f39-43c2-86c5-7cc60d669890 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:56.939586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fea08c-35f8-43be-87c8-cb09063602db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:56.940222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fea08c-35f8-43be-87c8-cb09063602db admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:56.940504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fea08c-35f8-43be-87c8-cb09063602db admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:56.940779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fea08c-35f8-43be-87c8-cb09063602db admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:56.941464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fea08c-35f8-43be-87c8-cb09063602db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:32:56.941774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fea08c-35f8-43be-87c8-cb09063602db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:56.943663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fea08c-35f8-43be-87c8-cb09063602db admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:56.978688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 840/1675] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:32:56.983582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffb6f7-148f-43cf-a015-445b54872d1f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:56.997434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffb6f7-148f-43cf-a015-445b54872d1f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:57.034945 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a858-af42-4966-ab9e-2af3359e14ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:57.036376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a858-af42-4966-ab9e-2af3359e14ea admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:57.036674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a858-af42-4966-ab9e-2af3359e14ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:57.037528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a858-af42-4966-ab9e-2af3359e14ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:57.039034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a858-af42-4966-ab9e-2af3359e14ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:57.040719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a858-af42-4966-ab9e-2af3359e14ea admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:57.132186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 836/1676] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:56 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:57.136307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fea08c-35f8-43be-87c8-cb09063602db admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:57.151315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fea08c-35f8-43be-87c8-cb09063602db admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:57.367641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf4b2c-845b-406e-9609-3bf9485b2a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:57.368279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf4b2c-845b-406e-9609-3bf9485b2a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:57.368561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf4b2c-845b-406e-9609-3bf9485b2a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:57.372398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf4b2c-845b-406e-9609-3bf9485b2a2d admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:57.373136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf4b2c-845b-406e-9609-3bf9485b2a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:57.375169 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf4b2c-845b-406e-9609-3bf9485b2a2d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:57.449443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 841/1677] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:57 2022] POST /identity/v3/users => generated 294 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:57.450718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a858-af42-4966-ab9e-2af3359e14ea admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:57.474547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a858-af42-4966-ab9e-2af3359e14ea admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:57.483387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46d3a5-421c-4e4c-8523-fee06e34fa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:57.483998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46d3a5-421c-4e4c-8523-fee06e34fa3b admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:57.489981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46d3a5-421c-4e4c-8523-fee06e34fa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:57.489981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46d3a5-421c-4e4c-8523-fee06e34fa3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:57.489981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46d3a5-421c-4e4c-8523-fee06e34fa3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:57.491639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46d3a5-421c-4e4c-8523-fee06e34fa3b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:57.540681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 837/1678] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:32:57.544846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf4b2c-845b-406e-9609-3bf9485b2a2d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:57.567961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf4b2c-845b-406e-9609-3bf9485b2a2d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:57.580135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf03222-6b3b-4db5-9b64-cffd19d92939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:57.580771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03222-6b3b-4db5-9b64-cffd19d92939 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:57.584793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03222-6b3b-4db5-9b64-cffd19d92939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:57.585201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03222-6b3b-4db5-9b64-cffd19d92939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:57.585840 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf03222-6b3b-4db5-9b64-cffd19d92939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:57.597749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf03222-6b3b-4db5-9b64-cffd19d92939 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:57.622341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 842/1679] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:57.626210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46d3a5-421c-4e4c-8523-fee06e34fa3b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:57.652786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46d3a5-421c-4e4c-8523-fee06e34fa3b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:57.675544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642697e1-f3cc-490a-a039-c3cfbeda8f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:57.676119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642697e1-f3cc-490a-a039-c3cfbeda8f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:57.676405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642697e1-f3cc-490a-a039-c3cfbeda8f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:57.676683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642697e1-f3cc-490a-a039-c3cfbeda8f6e admin admin] PATH_INFO: `/v3/projects/c68007b9ac19496b92d68ff32e362e08/users/4490bb7dd028469d962b15eff055d2bf/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:57.731105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642697e1-f3cc-490a-a039-c3cfbeda8f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68007b9ac19496b92d68ff32e362e08, user_id=4490bb7dd028469d962b15eff055d2bf, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:57.738297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642697e1-f3cc-490a-a039-c3cfbeda8f6e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:57.793835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 838/1680] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:57 2022] PUT /identity/v3/projects/c68007b9ac19496b92d68ff32e362e08/users/4490bb7dd028469d962b15eff055d2bf/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:57.795251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e055a-9c90-41d6-8bab-d806883a074f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:57.795547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e055a-9c90-41d6-8bab-d806883a074f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:57.795826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e055a-9c90-41d6-8bab-d806883a074f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:57.867378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b13e055a-9c90-41d6-8bab-d806883a074f None None] MFA Rules not processed for user `4490bb7dd028469d962b15eff055d2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:57.868626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b13e055a-9c90-41d6-8bab-d806883a074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:58.032337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 843/1681] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:58.036853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642697e1-f3cc-490a-a039-c3cfbeda8f6e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:58.084870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0e1b9-8c92-492f-be3b-ebbc6a867f74 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:58.085217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0e1b9-8c92-492f-be3b-ebbc6a867f74 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:58.085503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0e1b9-8c92-492f-be3b-ebbc6a867f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:58.149779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:58.154416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-47b0e1b9-8c92-492f-be3b-ebbc6a867f74 None None] MFA Rules not processed for user `a90756c9ba9541ffb3240b18af2e71c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:58.157260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-47b0e1b9-8c92-492f-be3b-ebbc6a867f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:58.193167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:58.254053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642697e1-f3cc-490a-a039-c3cfbeda8f6e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:58.290579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83401b0e-e045-42e8-9169-a52844b4deb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:58.291346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83401b0e-e045-42e8-9169-a52844b4deb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:58.291490 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83401b0e-e045-42e8-9169-a52844b4deb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:58.291764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83401b0e-e045-42e8-9169-a52844b4deb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:58.292418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83401b0e-e045-42e8-9169-a52844b4deb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:58.294518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83401b0e-e045-42e8-9169-a52844b4deb7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:58.387488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 839/1682] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:58 2022] POST /identity/v3/projects => generated 387 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:32:58.388419 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83401b0e-e045-42e8-9169-a52844b4deb7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:58.413883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 844/1683] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:58.414985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0e1b9-8c92-492f-be3b-ebbc6a867f74 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:58.430938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-47b0e1b9-8c92-492f-be3b-ebbc6a867f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:58.482636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0e1b9-8c92-492f-be3b-ebbc6a867f74 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:58.549469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83401b0e-e045-42e8-9169-a52844b4deb7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:58.563674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4e4b-0ab8-4b7e-8779-b07c4e837f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:58.564371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4e4b-0ab8-4b7e-8779-b07c4e837f01 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:58.565235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4e4b-0ab8-4b7e-8779-b07c4e837f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:58.566089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4e4b-0ab8-4b7e-8779-b07c4e837f01 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:58.567622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c4e4b-0ab8-4b7e-8779-b07c4e837f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:58.573791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c4e4b-0ab8-4b7e-8779-b07c4e837f01 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:58.622753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 840/1684] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:58 2022] POST /identity/v3/users => generated 300 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:58.626741 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4e4b-0ab8-4b7e-8779-b07c4e837f01 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:58.636062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83efae-63df-48c1-a8f6-bce0bd2f267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:58.636735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83efae-63df-48c1-a8f6-bce0bd2f267a admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:58.636996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83efae-63df-48c1-a8f6-bce0bd2f267a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:58.637269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83efae-63df-48c1-a8f6-bce0bd2f267a admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:58.641171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83efae-63df-48c1-a8f6-bce0bd2f267a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:58.646710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83efae-63df-48c1-a8f6-bce0bd2f267a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:58.649447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4e4b-0ab8-4b7e-8779-b07c4e837f01 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:58.667240 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20f061-694f-4d3a-bd3b-283ddc4f3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:58.667867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20f061-694f-4d3a-bd3b-283ddc4f3692 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:58.668152 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20f061-694f-4d3a-bd3b-283ddc4f3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:58.668429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20f061-694f-4d3a-bd3b-283ddc4f3692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:58.669113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20f061-694f-4d3a-bd3b-283ddc4f3692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:58.670730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20f061-694f-4d3a-bd3b-283ddc4f3692 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:58.701366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 841/1685] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:32:58.703346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20f061-694f-4d3a-bd3b-283ddc4f3692 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:58.711927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 845/1686] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:32:58 2022] POST /identity/v3/projects => generated 405 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:58.713085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83efae-63df-48c1-a8f6-bce0bd2f267a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:58.728165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20f061-694f-4d3a-bd3b-283ddc4f3692 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:58.885549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7ee61-e734-462f-92df-31bd070d3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:58.886387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7ee61-e734-462f-92df-31bd070d3b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:58.886808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7ee61-e734-462f-92df-31bd070d3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:58.887244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7ee61-e734-462f-92df-31bd070d3b53 admin admin] PATH_INFO: `/v3/projects/affff5fda56d4a2580995c4c816325d1/users/0e96acdfc5c24e7ca1624f9ee1586f29/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:58.890757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83efae-63df-48c1-a8f6-bce0bd2f267a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:58.907050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78f3f6-af85-4fe5-8b1e-2e205b28ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:58.907691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78f3f6-af85-4fe5-8b1e-2e205b28ff6c admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:58.907971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78f3f6-af85-4fe5-8b1e-2e205b28ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:58.908246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78f3f6-af85-4fe5-8b1e-2e205b28ff6c admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:58.908886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78f3f6-af85-4fe5-8b1e-2e205b28ff6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:58.910866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78f3f6-af85-4fe5-8b1e-2e205b28ff6c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:58.919087 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7ee61-e734-462f-92df-31bd070d3b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affff5fda56d4a2580995c4c816325d1, user_id=0e96acdfc5c24e7ca1624f9ee1586f29, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:58.922283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7ee61-e734-462f-92df-31bd070d3b53 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:58.961235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 846/1687] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:32:58 2022] POST /identity/v3/users => generated 309 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:32:58.962236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78f3f6-af85-4fe5-8b1e-2e205b28ff6c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:58.984642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 842/1688] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:58 2022] PUT /identity/v3/projects/affff5fda56d4a2580995c4c816325d1/users/0e96acdfc5c24e7ca1624f9ee1586f29/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:58.989223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7ee61-e734-462f-92df-31bd070d3b53 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:58.989716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78f3f6-af85-4fe5-8b1e-2e205b28ff6c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:59.030400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:59.059290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:59.124532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc6ba3-b7b8-408f-9689-e7e8dae450ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:59.125397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc6ba3-b7b8-408f-9689-e7e8dae450ca admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:59.125889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc6ba3-b7b8-408f-9689-e7e8dae450ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:59.127110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc6ba3-b7b8-408f-9689-e7e8dae450ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:59.128029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc6ba3-b7b8-408f-9689-e7e8dae450ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:59.130520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc6ba3-b7b8-408f-9689-e7e8dae450ca admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:59.160705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 847/1689] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:59.162601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc6ba3-b7b8-408f-9689-e7e8dae450ca admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:59.188224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc6ba3-b7b8-408f-9689-e7e8dae450ca admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:59.198799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7ee61-e734-462f-92df-31bd070d3b53 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:59.202959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f2580-4f22-464c-aba0-bb290b93484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:59.204534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2580-4f22-464c-aba0-bb290b93484d admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:59.204825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2580-4f22-464c-aba0-bb290b93484d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:59.205156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2580-4f22-464c-aba0-bb290b93484d admin admin] PATH_INFO: `/v3/projects/a04182873bca45e7a214f68b1017b30d/users/95ea852bc3304c28adf24a03cead4074/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:59.210413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afa9da-0d76-4d19-995d-41ad13e6cdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:59.212570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa9da-0d76-4d19-995d-41ad13e6cdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:59.212570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa9da-0d76-4d19-995d-41ad13e6cdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:59.212893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa9da-0d76-4d19-995d-41ad13e6cdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:59.214750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afa9da-0d76-4d19-995d-41ad13e6cdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:59.224045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afa9da-0d76-4d19-995d-41ad13e6cdf2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:59.257870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f2580-4f22-464c-aba0-bb290b93484d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04182873bca45e7a214f68b1017b30d, user_id=95ea852bc3304c28adf24a03cead4074, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:59.262587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 843/1690] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:59.263327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad110-0e12-4102-986d-318490c497d5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:59.263623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad110-0e12-4102-986d-318490c497d5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:59.264476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f2580-4f22-464c-aba0-bb290b93484d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:59.266083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ad110-0e12-4102-986d-318490c497d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:59.296444 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 848/1691] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:59 2022] PUT /identity/v3/projects/a04182873bca45e7a214f68b1017b30d/users/95ea852bc3304c28adf24a03cead4074/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:59.299464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f2580-4f22-464c-aba0-bb290b93484d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:59.352932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ae4ad110-0e12-4102-986d-318490c497d5 None None] MFA Rules not processed for user `8361c48f79a7419688d3f6b7289953e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:59.358213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ae4ad110-0e12-4102-986d-318490c497d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:59.487294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f2580-4f22-464c-aba0-bb290b93484d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:59.502217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805b478-b99e-4e4e-aeb1-8ddd24987383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:59.502914 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805b478-b99e-4e4e-aeb1-8ddd24987383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:59.503191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805b478-b99e-4e4e-aeb1-8ddd24987383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:59.503462 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805b478-b99e-4e4e-aeb1-8ddd24987383 admin admin] PATH_INFO: `/v3/projects/affff5fda56d4a2580995c4c816325d1/users/0e96acdfc5c24e7ca1624f9ee1586f29/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:59.506373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805b478-b99e-4e4e-aeb1-8ddd24987383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affff5fda56d4a2580995c4c816325d1, user_id=0e96acdfc5c24e7ca1624f9ee1586f29, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:59.509019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805b478-b99e-4e4e-aeb1-8ddd24987383 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:59.544727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 849/1692] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:32:59 2022] PUT /identity/v3/projects/affff5fda56d4a2580995c4c816325d1/users/0e96acdfc5c24e7ca1624f9ee1586f29/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:32:59.545741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805b478-b99e-4e4e-aeb1-8ddd24987383 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:59.547158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 844/1693] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:32:59.548255 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad110-0e12-4102-986d-318490c497d5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:32:59.554362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ae4ad110-0e12-4102-986d-318490c497d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:59.601827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ad110-0e12-4102-986d-318490c497d5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:59.700732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805b478-b99e-4e4e-aeb1-8ddd24987383 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:32:59.723896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90229854-1518-4950-98eb-fc4973fae34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:59.726197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90229854-1518-4950-98eb-fc4973fae34b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:59.730117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90229854-1518-4950-98eb-fc4973fae34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:59.731747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90229854-1518-4950-98eb-fc4973fae34b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:59.734802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90229854-1518-4950-98eb-fc4973fae34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:59.745119 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90229854-1518-4950-98eb-fc4973fae34b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:59.782708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 850/1694] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:32:59.786812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720c615-396f-4e68-b924-b556233dc875 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:59.794116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720c615-396f-4e68-b924-b556233dc875 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:59.794275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720c615-396f-4e68-b924-b556233dc875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:59.805102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:32:59.809705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:32:59.810129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:32:59.814879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] PATH_INFO: `/v3/users/7e88c48d013044d5b2fc270c74013872` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:32:59.819565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e88c48d013044d5b2fc270c74013872)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:32:59.821730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:32:59.892964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9720c615-396f-4e68-b924-b556233dc875 None None] MFA Rules not processed for user `0e96acdfc5c24e7ca1624f9ee1586f29`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:32:59.894871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9720c615-396f-4e68-b924-b556233dc875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:32:59.946281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:59.983268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:59.989660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e88c48d013044d5b2fc270c74013872'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:00.006801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e88c48d013044d5b2fc270c74013872'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:00.007596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e88c48d013044d5b2fc270c74013872'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:00.025663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e88c48d013044d5b2fc270c74013872'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:00.073556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-04061aaa-bd54-4513-b8b7-fa45fdf6cf35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e88c48d013044d5b2fc270c74013872'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:00.086192 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 845/1695] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:32:59 2022] DELETE /identity/v3/users/7e88c48d013044d5b2fc270c74013872 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:00.088373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb2f78-bf73-4d31-bb1f-41387886f3a8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:00.090465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb2f78-bf73-4d31-bb1f-41387886f3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:00.090886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb2f78-bf73-4d31-bb1f-41387886f3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:00.135524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 851/1696] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:32:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:00.135524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720c615-396f-4e68-b924-b556233dc875 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:00.139222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9720c615-396f-4e68-b924-b556233dc875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:00.161826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-10bb2f78-bf73-4d31-bb1f-41387886f3a8 None None] MFA Rules not processed for user `8361c48f79a7419688d3f6b7289953e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:00.167063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-10bb2f78-bf73-4d31-bb1f-41387886f3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:00.196127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720c615-396f-4e68-b924-b556233dc875 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:00.379788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 846/1697] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:00.381317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a1f4-4b9a-42f9-9c15-7929931543f1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:00.381610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a1f4-4b9a-42f9-9c15-7929931543f1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:00.381884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a1f4-4b9a-42f9-9c15-7929931543f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:00.403702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95518c14-685b-4aa8-bbc4-c8b0a3ee2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:00.404765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95518c14-685b-4aa8-bbc4-c8b0a3ee2533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:00.405077 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95518c14-685b-4aa8-bbc4-c8b0a3ee2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:00.405353 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95518c14-685b-4aa8-bbc4-c8b0a3ee2533 admin admin] PATH_INFO: `/v3/projects/a04182873bca45e7a214f68b1017b30d/users/95ea852bc3304c28adf24a03cead4074/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:00.409270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95518c14-685b-4aa8-bbc4-c8b0a3ee2533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04182873bca45e7a214f68b1017b30d, user_id=95ea852bc3304c28adf24a03cead4074, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:00.412110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95518c14-685b-4aa8-bbc4-c8b0a3ee2533 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:00.421818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6ef5a1f4-4b9a-42f9-9c15-7929931543f1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:00.425067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6ef5a1f4-4b9a-42f9-9c15-7929931543f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:00.436873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 852/1698] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:00 2022] PUT /identity/v3/projects/a04182873bca45e7a214f68b1017b30d/users/95ea852bc3304c28adf24a03cead4074/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:00.437522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95518c14-685b-4aa8-bbc4-c8b0a3ee2533 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:00.442271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-95518c14-685b-4aa8-bbc4-c8b0a3ee2533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:00.558825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 847/1699] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:00.559717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a1f4-4b9a-42f9-9c15-7929931543f1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:00.561203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6ef5a1f4-4b9a-42f9-9c15-7929931543f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:00.565236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95518c14-685b-4aa8-bbc4-c8b0a3ee2533 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:00.579990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584a9b8-10a1-4f96-8804-c8aaa0d1ffd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:00.581717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584a9b8-10a1-4f96-8804-c8aaa0d1ffd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:00.583588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584a9b8-10a1-4f96-8804-c8aaa0d1ffd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:00.584528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584a9b8-10a1-4f96-8804-c8aaa0d1ffd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:00.770060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a1f4-4b9a-42f9-9c15-7929931543f1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:00.776877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584a9b8-10a1-4f96-8804-c8aaa0d1ffd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:00.779580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584a9b8-10a1-4f96-8804-c8aaa0d1ffd7 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:00.781950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023cab7-44ba-49bc-8bf3-b633f07b0ea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:00.782855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023cab7-44ba-49bc-8bf3-b633f07b0ea4 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:00.783187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023cab7-44ba-49bc-8bf3-b633f07b0ea4 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:00.783525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023cab7-44ba-49bc-8bf3-b633f07b0ea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:00.787961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b023cab7-44ba-49bc-8bf3-b633f07b0ea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:00.801219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:00.805871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:00.812819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 853/1700] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:00.813947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584a9b8-10a1-4f96-8804-c8aaa0d1ffd7 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:00.817951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e584a9b8-10a1-4f96-8804-c8aaa0d1ffd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:00.966867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023cab7-44ba-49bc-8bf3-b633f07b0ea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:00.979568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584a9b8-10a1-4f96-8804-c8aaa0d1ffd7 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:00.987707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d670d-081e-4662-974f-dbe13f316409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:00.988326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d670d-081e-4662-974f-dbe13f316409 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:00.988608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d670d-081e-4662-974f-dbe13f316409 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:00.988879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d670d-081e-4662-974f-dbe13f316409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:00.990958 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023cab7-44ba-49bc-8bf3-b633f07b0ea4 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:01.029569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 848/1701] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:01.043651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d670d-081e-4662-974f-dbe13f316409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:01.045117 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d670d-081e-4662-974f-dbe13f316409 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:01.060821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e2c1e-7da8-4723-b1eb-cefd2a9ac4da None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:01.062520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e2c1e-7da8-4723-b1eb-cefd2a9ac4da None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:01.063462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e2c1e-7da8-4723-b1eb-cefd2a9ac4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:01.093264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 854/1702] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:01.106151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de891f2-7f52-4154-a373-6184e1472881 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:01.106437 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de891f2-7f52-4154-a373-6184e1472881 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:01.106718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de891f2-7f52-4154-a373-6184e1472881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:01.166607 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fc8e2c1e-7da8-4723-b1eb-cefd2a9ac4da None None] MFA Rules not processed for user `85869eddd2924f85a318e77184c5607b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:01.169994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fc8e2c1e-7da8-4723-b1eb-cefd2a9ac4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:01.212356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6de891f2-7f52-4154-a373-6184e1472881 None None] MFA Rules not processed for user `beee7ecbe9554a46a6be476aa5b2ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:01.214851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6de891f2-7f52-4154-a373-6184e1472881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:01.422284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 855/1703] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:01.424594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de891f2-7f52-4154-a373-6184e1472881 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:01.429929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6de891f2-7f52-4154-a373-6184e1472881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:01.462433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de891f2-7f52-4154-a373-6184e1472881 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:01.470359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:01.471258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:01.473484 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 849/1704] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:01.474441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e2c1e-7da8-4723-b1eb-cefd2a9ac4da None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:01.483753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fc8e2c1e-7da8-4723-b1eb-cefd2a9ac4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:01.485101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:01.487269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] PATH_INFO: `/v3/users/4490bb7dd028469d962b15eff055d2bf` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:01.491707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4490bb7dd028469d962b15eff055d2bf)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:01.499474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:01.508222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e2c1e-7da8-4723-b1eb-cefd2a9ac4da None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:01.516556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1569fe6-caa0-45a8-aaf3-dd588d04e347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:01.518159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1569fe6-caa0-45a8-aaf3-dd588d04e347 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:01.518622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1569fe6-caa0-45a8-aaf3-dd588d04e347 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:01.519039 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1569fe6-caa0-45a8-aaf3-dd588d04e347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:01.527696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1569fe6-caa0-45a8-aaf3-dd588d04e347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:01.529748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1569fe6-caa0-45a8-aaf3-dd588d04e347 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:01.559781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 850/1705] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:01.561284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be90f8-fbea-44d9-8126-b0a3e3a5711a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:01.564402 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be90f8-fbea-44d9-8126-b0a3e3a5711a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:01.564846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be90f8-fbea-44d9-8126-b0a3e3a5711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:01.620620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-40be90f8-fbea-44d9-8126-b0a3e3a5711a None None] MFA Rules not processed for user `85869eddd2924f85a318e77184c5607b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:01.629362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-40be90f8-fbea-44d9-8126-b0a3e3a5711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:01.660057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4490bb7dd028469d962b15eff055d2bf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:01.665053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4490bb7dd028469d962b15eff055d2bf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:01.665591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 851/1706] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:01.692229 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4490bb7dd028469d962b15eff055d2bf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:01.763447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4490bb7dd028469d962b15eff055d2bf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:01.772029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6656b568-b95e-4e3b-82ed-91397d12cb3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4490bb7dd028469d962b15eff055d2bf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:01.790282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be90f8-fbea-44d9-8126-b0a3e3a5711a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:01.818691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 856/1707] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:01 2022] DELETE /identity/v3/users/4490bb7dd028469d962b15eff055d2bf => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:01.821933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be90f8-fbea-44d9-8126-b0a3e3a5711a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:01.825937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566616d-e3b5-4656-8d4b-06ddf3f69a9d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:01.826298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566616d-e3b5-4656-8d4b-06ddf3f69a9d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:01.826496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566616d-e3b5-4656-8d4b-06ddf3f69a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:01.842355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:01.874904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f566616d-e3b5-4656-8d4b-06ddf3f69a9d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:01.876852 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f566616d-e3b5-4656-8d4b-06ddf3f69a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:02.072622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 857/1708] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:02.086179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec40586-c5c9-415a-be3c-459e24cb37d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:02.086800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec40586-c5c9-415a-be3c-459e24cb37d3 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:02.087077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec40586-c5c9-415a-be3c-459e24cb37d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:02.087347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec40586-c5c9-415a-be3c-459e24cb37d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:02.110008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1ec40586-c5c9-415a-be3c-459e24cb37d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:02.133274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:02.169207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566616d-e3b5-4656-8d4b-06ddf3f69a9d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:02.170795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f566616d-e3b5-4656-8d4b-06ddf3f69a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:02.294567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566616d-e3b5-4656-8d4b-06ddf3f69a9d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:02.298642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b82a49-4c46-427d-8157-fbbc6825c026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:02.299345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82a49-4c46-427d-8157-fbbc6825c026 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:02.299634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82a49-4c46-427d-8157-fbbc6825c026 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:02.300156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82a49-4c46-427d-8157-fbbc6825c026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:02.312511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec40586-c5c9-415a-be3c-459e24cb37d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:02.313831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec40586-c5c9-415a-be3c-459e24cb37d3 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:02.315250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b82a49-4c46-427d-8157-fbbc6825c026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:02.316623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b82a49-4c46-427d-8157-fbbc6825c026 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:02.329107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 858/1709] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:02.340230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 852/1710] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:02.398514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37a7f-46fb-43c7-8372-65b59de0ff0f None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:02.398989 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37a7f-46fb-43c7-8372-65b59de0ff0f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:02.399420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce37a7f-46fb-43c7-8372-65b59de0ff0f None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:02.401410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 859/1711] 10.222.0.18 () {54 vars in 912 bytes} [Mon Sep 26 10:33:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:33:02.425477 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2432cd-2302-43eb-8ad6-5c4fdaa6077d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:02.426279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2432cd-2302-43eb-8ad6-5c4fdaa6077d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:02.426279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2432cd-2302-43eb-8ad6-5c4fdaa6077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:02.508867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9b2432cd-2302-43eb-8ad6-5c4fdaa6077d None None] MFA Rules not processed for user `ad0f25125b534983af66d5326f4d626d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:02.510282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9b2432cd-2302-43eb-8ad6-5c4fdaa6077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:02.526041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 853/1712] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:33:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:02.577770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37a7f-46fb-43c7-8372-65b59de0ff0f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:02.579607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1ce37a7f-46fb-43c7-8372-65b59de0ff0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:02.602222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce37a7f-46fb-43c7-8372-65b59de0ff0f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:02.624887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2fd04-d781-49d4-846b-7dcb46a2c505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:02.626360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2fd04-d781-49d4-846b-7dcb46a2c505 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:02.626795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2fd04-d781-49d4-846b-7dcb46a2c505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:02.627217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2fd04-d781-49d4-846b-7dcb46a2c505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:02.651540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2fd04-d781-49d4-846b-7dcb46a2c505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:02.654254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2fd04-d781-49d4-846b-7dcb46a2c505 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:02.678340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 860/1713] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:03.500644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabc7a-6446-4f69-9301-75a066c56d09 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:03.501288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabc7a-6446-4f69-9301-75a066c56d09 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:03.501288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabc7a-6446-4f69-9301-75a066c56d09 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:03.502991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 854/1714] 10.222.0.18 () {54 vars in 912 bytes} [Mon Sep 26 10:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:33:03.512373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134f5e7-bba5-46ce-9aa1-21d03709a8e3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:03.512835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134f5e7-bba5-46ce-9aa1-21d03709a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:03.512903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134f5e7-bba5-46ce-9aa1-21d03709a8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:03.551381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8134f5e7-bba5-46ce-9aa1-21d03709a8e3 None None] MFA Rules not processed for user `ad0f25125b534983af66d5326f4d626d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:03.552617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8134f5e7-bba5-46ce-9aa1-21d03709a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:03.583733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 861/1715] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:33:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:03.627506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cabc7a-6446-4f69-9301-75a066c56d09 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:03.641603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cabc7a-6446-4f69-9301-75a066c56d09 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:03.651132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6fb8e-2446-4f16-a810-bb9fa2929489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:03.652006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fb8e-2446-4f16-a810-bb9fa2929489 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:03.652488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fb8e-2446-4f16-a810-bb9fa2929489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:03.652930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fb8e-2446-4f16-a810-bb9fa2929489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:03.692364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6fb8e-2446-4f16-a810-bb9fa2929489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:03.695352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6fb8e-2446-4f16-a810-bb9fa2929489 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:03.711132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 855/1716] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:03.777157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134f5e7-bba5-46ce-9aa1-21d03709a8e3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:03.778669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8134f5e7-bba5-46ce-9aa1-21d03709a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:03.805051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134f5e7-bba5-46ce-9aa1-21d03709a8e3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:03.813696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:03.814354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:03.814631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:03.814900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] PATH_INFO: `/v3/projects/b4e717dbe1904e2ba39b4ccabd2e2835` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:03.819187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e717dbe1904e2ba39b4ccabd2e2835)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:03.823052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:03.909344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e717dbe1904e2ba39b4ccabd2e2835', 'request_id': 'req-89a356b0-c3e2-43c7-932d-4701e3952940'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:03.920933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e717dbe1904e2ba39b4ccabd2e2835', 'request_id': 'req-89a356b0-c3e2-43c7-932d-4701e3952940'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:03.935391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e717dbe1904e2ba39b4ccabd2e2835', 'request_id': 'req-89a356b0-c3e2-43c7-932d-4701e3952940'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:03.958977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] The token cache is being invalidate because project b4e717dbe1904e2ba39b4ccabd2e2835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:03.959267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:03.965415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89a356b0-c3e2-43c7-932d-4701e3952940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:03.969269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 862/1717] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:03 2022] DELETE /identity/v3/projects/b4e717dbe1904e2ba39b4ccabd2e2835 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:03.973475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6fb8e-2446-4f16-a810-bb9fa2929489 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:03.993676 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6fb8e-2446-4f16-a810-bb9fa2929489 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:04.122652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:04.123237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:04.123517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:04.123792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] PATH_INFO: `/v3/users/a87e7454656b4568be23aac694f457a8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:04.128857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87e7454656b4568be23aac694f457a8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:04.131525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:04.239468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a72c7-7f86-46a5-8a2e-3a321ca6d221 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:04.239969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a72c7-7f86-46a5-8a2e-3a321ca6d221 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:04.241053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a72c7-7f86-46a5-8a2e-3a321ca6d221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:04.299869 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87e7454656b4568be23aac694f457a8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:04.311579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:04.328807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87e7454656b4568be23aac694f457a8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:04.331729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87e7454656b4568be23aac694f457a8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:04.349091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-282a72c7-7f86-46a5-8a2e-3a321ca6d221 None None] MFA Rules not processed for user `95ea852bc3304c28adf24a03cead4074`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:04.358513 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87e7454656b4568be23aac694f457a8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:04.370942 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-282a72c7-7f86-46a5-8a2e-3a321ca6d221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:04.413150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87e7454656b4568be23aac694f457a8'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:04.419544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:04.439489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 856/1718] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:03 2022] DELETE /identity/v3/users/a87e7454656b4568be23aac694f457a8 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:04.562951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 863/1719] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:04.688874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:04.690715 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:04.895185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a72c7-7f86-46a5-8a2e-3a321ca6d221 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:04.900025 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-282a72c7-7f86-46a5-8a2e-3a321ca6d221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:04.930449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe984a97-dc2f-43ea-9be9-10188c90a191 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:04.955962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:04.960349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:04.963019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:04.964392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] PATH_INFO: `/v3/projects/c68007b9ac19496b92d68ff32e362e08` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:04.977518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68007b9ac19496b92d68ff32e362e08)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:04.981649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:05.128388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a72c7-7f86-46a5-8a2e-3a321ca6d221 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:05.139187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68007b9ac19496b92d68ff32e362e08', 'request_id': 'req-bf9fe0a2-3671-4d86-82a9-0073939622aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:05.156884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68007b9ac19496b92d68ff32e362e08', 'request_id': 'req-bf9fe0a2-3671-4d86-82a9-0073939622aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:05.171895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68007b9ac19496b92d68ff32e362e08', 'request_id': 'req-bf9fe0a2-3671-4d86-82a9-0073939622aa'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:05.202927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] The token cache is being invalidate because project c68007b9ac19496b92d68ff32e362e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:05.203242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:05.205140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bf9fe0a2-3671-4d86-82a9-0073939622aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:05.212666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 857/1720] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:04 2022] DELETE /identity/v3/projects/c68007b9ac19496b92d68ff32e362e08 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:05.215855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f58d5-39e6-4841-8736-4e5b8e699263 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:05.216961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f58d5-39e6-4841-8736-4e5b8e699263 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:05.218815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f58d5-39e6-4841-8736-4e5b8e699263 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:05.227203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 858/1721] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 10:33:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:33:05.228281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f58d5-39e6-4841-8736-4e5b8e699263 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:05.231812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8c5f58d5-39e6-4841-8736-4e5b8e699263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:05.288428 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59843ea-8e06-474c-97e5-d3d7c08b1192 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:05.289242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59843ea-8e06-474c-97e5-d3d7c08b1192 service placement] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:05.289651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59843ea-8e06-474c-97e5-d3d7c08b1192 service placement] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:05.290070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59843ea-8e06-474c-97e5-d3d7c08b1192 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:05.296919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d59843ea-8e06-474c-97e5-d3d7c08b1192 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:05.335650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59843ea-8e06-474c-97e5-d3d7c08b1192 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:05.337646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59843ea-8e06-474c-97e5-d3d7c08b1192 service placement] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:05.400290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 864/1722] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:05.401994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc337f6e-08a3-4e42-9043-ae5e593deb2d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:05.405317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc337f6e-08a3-4e42-9043-ae5e593deb2d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:05.406753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc337f6e-08a3-4e42-9043-ae5e593deb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:05.486285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f58d5-39e6-4841-8736-4e5b8e699263 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:05.496312 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-dc337f6e-08a3-4e42-9043-ae5e593deb2d None None] MFA Rules not processed for user `794990333d3748abad7683590b0e5d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:05.497607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-dc337f6e-08a3-4e42-9043-ae5e593deb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:05.501930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:05.502594 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:05.502874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:05.503147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] PATH_INFO: `/v3/users/0e96acdfc5c24e7ca1624f9ee1586f29` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:05.506877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e96acdfc5c24e7ca1624f9ee1586f29)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:05.508833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:05.535534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 865/1723] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 10:33:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:05.537011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7797-d225-407d-ab87-fe73f0fdc976 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:05.537352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7797-d225-407d-ab87-fe73f0fdc976 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:05.537618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7797-d225-407d-ab87-fe73f0fdc976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:05.578971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:05.608136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e96acdfc5c24e7ca1624f9ee1586f29'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:05.627686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e96acdfc5c24e7ca1624f9ee1586f29'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:05.628350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e96acdfc5c24e7ca1624f9ee1586f29'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:05.639297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e96acdfc5c24e7ca1624f9ee1586f29'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:05.651366 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-17fb7797-d225-407d-ab87-fe73f0fdc976 None None] MFA Rules not processed for user `e0589d6270464a4c8f5ed7680ca48164`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:05.652818 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-17fb7797-d225-407d-ab87-fe73f0fdc976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:05.665320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-99cf910d-2893-4d8f-a016-a938d2818145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e96acdfc5c24e7ca1624f9ee1586f29'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:05.680998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 859/1724] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:05 2022] DELETE /identity/v3/users/0e96acdfc5c24e7ca1624f9ee1586f29 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:05.680998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081923-dbc7-4e16-8c9b-517ae8bb1674 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:05.680998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081923-dbc7-4e16-8c9b-517ae8bb1674 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:05.680998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081923-dbc7-4e16-8c9b-517ae8bb1674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:05.693374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:05.730152 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-23081923-dbc7-4e16-8c9b-517ae8bb1674 None None] MFA Rules not processed for user `85869eddd2924f85a318e77184c5607b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:05.731403 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-23081923-dbc7-4e16-8c9b-517ae8bb1674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:05.862513 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 860/1725] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:05.867405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081923-dbc7-4e16-8c9b-517ae8bb1674 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:05.869384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-23081923-dbc7-4e16-8c9b-517ae8bb1674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:05.902572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 866/1726] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:05.920172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb7797-d225-407d-ab87-fe73f0fdc976 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:05.922471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-17fb7797-d225-407d-ab87-fe73f0fdc976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:06.064446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081923-dbc7-4e16-8c9b-517ae8bb1674 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:06.074064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53430b3-33c3-4be3-bbec-10787c831995 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:06.075117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53430b3-33c3-4be3-bbec-10787c831995 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:06.078557 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53430b3-33c3-4be3-bbec-10787c831995 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:06.079547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53430b3-33c3-4be3-bbec-10787c831995 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:06.082422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e53430b3-33c3-4be3-bbec-10787c831995 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:06.102962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53430b3-33c3-4be3-bbec-10787c831995 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:06.106099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53430b3-33c3-4be3-bbec-10787c831995 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:06.124107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 861/1727] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:06.257280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb7797-d225-407d-ab87-fe73f0fdc976 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:06.354753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53430b3-33c3-4be3-bbec-10787c831995 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:06.356874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e53430b3-33c3-4be3-bbec-10787c831995 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:06.454584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b118161-5498-49b8-af8b-c1b1174bf9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:06.457122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b118161-5498-49b8-af8b-c1b1174bf9d2 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:06.457541 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b118161-5498-49b8-af8b-c1b1174bf9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:06.458042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b118161-5498-49b8-af8b-c1b1174bf9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:06.588062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:06.634682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53430b3-33c3-4be3-bbec-10787c831995 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:06.640594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:06.642700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:06.643479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:06.643864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:06.644310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] PATH_INFO: `/v3/projects/374f15e2cd674cd38b96edc5fd858062` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:06.645676 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=374f15e2cd674cd38b96edc5fd858062)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:06.655399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:06.694089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b118161-5498-49b8-af8b-c1b1174bf9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:06.695724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b118161-5498-49b8-af8b-c1b1174bf9d2 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:06.736216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 867/1728] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 818 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:06.777691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374f15e2cd674cd38b96edc5fd858062', 'request_id': 'req-22a2f820-b98f-41c9-8bb4-446ec27d19ab'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:06.819087 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374f15e2cd674cd38b96edc5fd858062', 'request_id': 'req-22a2f820-b98f-41c9-8bb4-446ec27d19ab'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:06.857986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374f15e2cd674cd38b96edc5fd858062', 'request_id': 'req-22a2f820-b98f-41c9-8bb4-446ec27d19ab'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:06.899818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] The token cache is being invalidate because project 374f15e2cd674cd38b96edc5fd858062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:06.900118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:06.906526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-22a2f820-b98f-41c9-8bb4-446ec27d19ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:06.911429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 862/1729] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:06 2022] DELETE /identity/v3/projects/374f15e2cd674cd38b96edc5fd858062 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:06.916159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffb66b-0c3f-473a-8c5a-f24409b4f677 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:06.916640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffb66b-0c3f-473a-8c5a-f24409b4f677 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:06.917219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffb66b-0c3f-473a-8c5a-f24409b4f677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:06.993842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-22ffb66b-0c3f-473a-8c5a-f24409b4f677 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:06.995085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-22ffb66b-0c3f-473a-8c5a-f24409b4f677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:07.200601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 868/1730] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:07.209674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32606a-901b-4541-aac8-3e1a779c92a3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:07.209963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32606a-901b-4541-aac8-3e1a779c92a3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:07.210241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32606a-901b-4541-aac8-3e1a779c92a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:07.254270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3f32606a-901b-4541-aac8-3e1a779c92a3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:07.259143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3f32606a-901b-4541-aac8-3e1a779c92a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:07.287828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 863/1731] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:07.291802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffb66b-0c3f-473a-8c5a-f24409b4f677 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:07.310219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffb66b-0c3f-473a-8c5a-f24409b4f677 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:07.349796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf3cb4-8e7f-4565-82a6-764cdd430c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:07.350662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf3cb4-8e7f-4565-82a6-764cdd430c39 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:07.351089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf3cb4-8e7f-4565-82a6-764cdd430c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:07.351503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf3cb4-8e7f-4565-82a6-764cdd430c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:07.368367 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf3cb4-8e7f-4565-82a6-764cdd430c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:07.368819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf3cb4-8e7f-4565-82a6-764cdd430c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:07.370493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf3cb4-8e7f-4565-82a6-764cdd430c39 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:07.411722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 869/1732] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:07.417555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32606a-901b-4541-aac8-3e1a779c92a3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:07.443722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32606a-901b-4541-aac8-3e1a779c92a3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:07.468177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb87d2-4acb-4960-ac63-5c398c8c892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:07.468803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb87d2-4acb-4960-ac63-5c398c8c892d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:07.469136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb87d2-4acb-4960-ac63-5c398c8c892d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:07.469407 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb87d2-4acb-4960-ac63-5c398c8c892d admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:07.470396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb87d2-4acb-4960-ac63-5c398c8c892d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:07.471979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb87d2-4acb-4960-ac63-5c398c8c892d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:07.588566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 864/1733] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:07 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:07.592983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf3cb4-8e7f-4565-82a6-764cdd430c39 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:07.607199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf3cb4-8e7f-4565-82a6-764cdd430c39 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:07.612849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924887e9-1067-42e2-b287-0567ccecc84a None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:07.613808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924887e9-1067-42e2-b287-0567ccecc84a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:07.613808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924887e9-1067-42e2-b287-0567ccecc84a None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:07.614794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 865/1734] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:33:07.695054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd638b5-5511-4262-8ce1-ba13a93744c6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:07.695339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd638b5-5511-4262-8ce1-ba13a93744c6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:07.695616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd638b5-5511-4262-8ce1-ba13a93744c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:07.785655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ffd638b5-5511-4262-8ce1-ba13a93744c6 None None] MFA Rules not processed for user `794990333d3748abad7683590b0e5d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:07.786800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ffd638b5-5511-4262-8ce1-ba13a93744c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:07.880234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb4c62-5a6d-42f3-980d-e0c45a914c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:07.882170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4c62-5a6d-42f3-980d-e0c45a914c68 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:07.882653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4c62-5a6d-42f3-980d-e0c45a914c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:07.883119 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4c62-5a6d-42f3-980d-e0c45a914c68 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:07.885017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb4c62-5a6d-42f3-980d-e0c45a914c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:07.892035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb4c62-5a6d-42f3-980d-e0c45a914c68 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:07.947807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 870/1735] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:07 2022] POST /identity/v3/users => generated 294 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:07.949789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb4c62-5a6d-42f3-980d-e0c45a914c68 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:07.972676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb4c62-5a6d-42f3-980d-e0c45a914c68 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:07.991759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c197-a542-4c80-8a57-ba103e441e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:07.992650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c197-a542-4c80-8a57-ba103e441e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:07.993265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c197-a542-4c80-8a57-ba103e441e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:08.005272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c197-a542-4c80-8a57-ba103e441e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:08.008634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0c197-a542-4c80-8a57-ba103e441e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:08.010536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0c197-a542-4c80-8a57-ba103e441e05 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:08.022116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 866/1736] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:08.046073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 871/1737] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:08.050533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd638b5-5511-4262-8ce1-ba13a93744c6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:08.081169 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd638b5-5511-4262-8ce1-ba13a93744c6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:08.096242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8005c-bff4-4b4f-a096-fa4404c6bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:08.101833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8005c-bff4-4b4f-a096-fa4404c6bdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:08.106983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8005c-bff4-4b4f-a096-fa4404c6bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:08.112738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8005c-bff4-4b4f-a096-fa4404c6bdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:08.114299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8005c-bff4-4b4f-a096-fa4404c6bdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:08.119496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8005c-bff4-4b4f-a096-fa4404c6bdc3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:08.129064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c197-a542-4c80-8a57-ba103e441e05 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:08.130948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d5e0c197-a542-4c80-8a57-ba103e441e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:08.171806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c197-a542-4c80-8a57-ba103e441e05 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:08.178409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 867/1738] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:08.185407 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8005c-bff4-4b4f-a096-fa4404c6bdc3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:08.197557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2a06f-7f66-4f3d-9e3d-9df08e2df9b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:08.198344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2a06f-7f66-4f3d-9e3d-9df08e2df9b6 service placement] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:08.198567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2a06f-7f66-4f3d-9e3d-9df08e2df9b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:08.198897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2a06f-7f66-4f3d-9e3d-9df08e2df9b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:08.211796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8005c-bff4-4b4f-a096-fa4404c6bdc3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:08.232364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2a06f-7f66-4f3d-9e3d-9df08e2df9b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:08.232364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2a06f-7f66-4f3d-9e3d-9df08e2df9b6 service placement] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:08.241959 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e93aae-04c8-4c89-832d-76f3ec80c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:08.242651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e93aae-04c8-4c89-832d-76f3ec80c3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:08.242933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e93aae-04c8-4c89-832d-76f3ec80c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:08.243204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e93aae-04c8-4c89-832d-76f3ec80c3fd admin admin] PATH_INFO: `/v3/projects/df19b1d3cee44d31b5cffeb2adb4b979/users/09d472fe010f435c954db3da82b21655/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:08.276000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 872/1739] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:08.277713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271195a-081f-43d5-8d6a-98e7244d33b9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:08.278683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271195a-081f-43d5-8d6a-98e7244d33b9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:08.278967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271195a-081f-43d5-8d6a-98e7244d33b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:08.310483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e93aae-04c8-4c89-832d-76f3ec80c3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=df19b1d3cee44d31b5cffeb2adb4b979, user_id=09d472fe010f435c954db3da82b21655, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:08.316290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e93aae-04c8-4c89-832d-76f3ec80c3fd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:08.343788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c271195a-081f-43d5-8d6a-98e7244d33b9 None None] MFA Rules not processed for user `beee7ecbe9554a46a6be476aa5b2ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:08.345787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c271195a-081f-43d5-8d6a-98e7244d33b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:08.369878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 868/1740] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:08 2022] PUT /identity/v3/projects/df19b1d3cee44d31b5cffeb2adb4b979/users/09d472fe010f435c954db3da82b21655/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:08.371633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca51f-8c8d-4a47-a810-311521afb74d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:08.371916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca51f-8c8d-4a47-a810-311521afb74d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:08.372191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca51f-8c8d-4a47-a810-311521afb74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:08.417828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:08.433416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:08.478115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 873/1741] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:08.482705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-092ca51f-8c8d-4a47-a810-311521afb74d None None] MFA Rules not processed for user `09d472fe010f435c954db3da82b21655`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:08.510746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-092ca51f-8c8d-4a47-a810-311521afb74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:08.681681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 869/1742] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:08.687369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271195a-081f-43d5-8d6a-98e7244d33b9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:08.773720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ca51f-8c8d-4a47-a810-311521afb74d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:08.775426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-092ca51f-8c8d-4a47-a810-311521afb74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:08.851031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271195a-081f-43d5-8d6a-98e7244d33b9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:08.865377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f8d5c-f76a-4258-895d-af305cf8f5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:08.867580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f8d5c-f76a-4258-895d-af305cf8f5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:08.867744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f8d5c-f76a-4258-895d-af305cf8f5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:08.868012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f8d5c-f76a-4258-895d-af305cf8f5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:08.870454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f8d5c-f76a-4258-895d-af305cf8f5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:08.875950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f8d5c-f76a-4258-895d-af305cf8f5b3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:08.952223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 874/1743] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:08 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:08.955025 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f8d5c-f76a-4258-895d-af305cf8f5b3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:09.111753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ca51f-8c8d-4a47-a810-311521afb74d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:09.171775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f8d5c-f76a-4258-895d-af305cf8f5b3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:09.177413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28cfe6-df98-4f9b-813b-3fe55e6ca308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:09.177927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28cfe6-df98-4f9b-813b-3fe55e6ca308 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:09.178230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28cfe6-df98-4f9b-813b-3fe55e6ca308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:09.178490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28cfe6-df98-4f9b-813b-3fe55e6ca308 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:09.179126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28cfe6-df98-4f9b-813b-3fe55e6ca308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:09.182829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28cfe6-df98-4f9b-813b-3fe55e6ca308 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:09.262517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 875/1744] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:08 2022] POST /identity/v3/users => generated 299 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:09.263567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28cfe6-df98-4f9b-813b-3fe55e6ca308 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:09.289453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:09.290349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:09.290623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:09.291019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] PATH_INFO: `/v3/users/a90756c9ba9541ffb3240b18af2e71c3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:09.293023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90756c9ba9541ffb3240b18af2e71c3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:09.298836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:09.300139 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28cfe6-df98-4f9b-813b-3fe55e6ca308 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:09.307957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84f957-59fe-4377-bdf1-8fcb56302606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:09.308860 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f957-59fe-4377-bdf1-8fcb56302606 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:09.309272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f957-59fe-4377-bdf1-8fcb56302606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:09.309781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f957-59fe-4377-bdf1-8fcb56302606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:09.310963 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84f957-59fe-4377-bdf1-8fcb56302606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:09.313616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84f957-59fe-4377-bdf1-8fcb56302606 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:09.350022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 876/1745] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:09.351288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84f957-59fe-4377-bdf1-8fcb56302606 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:09.353406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5d84f957-59fe-4377-bdf1-8fcb56302606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:09.375732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84f957-59fe-4377-bdf1-8fcb56302606 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:09.381694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:09.388959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:09.390126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:09.390511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] PATH_INFO: `/v3/projects/affff5fda56d4a2580995c4c816325d1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:09.393347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=affff5fda56d4a2580995c4c816325d1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:09.397755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:09.435541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:09.444418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90756c9ba9541ffb3240b18af2e71c3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:09.469053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90756c9ba9541ffb3240b18af2e71c3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:09.469684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90756c9ba9541ffb3240b18af2e71c3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:09.481660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90756c9ba9541ffb3240b18af2e71c3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:09.491583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:09.496581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affff5fda56d4a2580995c4c816325d1', 'request_id': 'req-569f5c11-3ded-4c79-a231-95928f40e9fe'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:09.507772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affff5fda56d4a2580995c4c816325d1', 'request_id': 'req-569f5c11-3ded-4c79-a231-95928f40e9fe'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:09.514341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90756c9ba9541ffb3240b18af2e71c3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:09.524348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affff5fda56d4a2580995c4c816325d1', 'request_id': 'req-569f5c11-3ded-4c79-a231-95928f40e9fe'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:09.532192 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 870/1746] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:08 2022] DELETE /identity/v3/users/a90756c9ba9541ffb3240b18af2e71c3 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:09.533276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:09.538585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:09.563196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] The token cache is being invalidate because project affff5fda56d4a2580995c4c816325d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:09.565943 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:09.569807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-569f5c11-3ded-4c79-a231-95928f40e9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:09.575085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 877/1747] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:09 2022] DELETE /identity/v3/projects/affff5fda56d4a2580995c4c816325d1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:09.581227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc44f51-564e-4134-8af0-6ff67335027d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:09.581517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc44f51-564e-4134-8af0-6ff67335027d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:09.581793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc44f51-564e-4134-8af0-6ff67335027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:09.638491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-afc44f51-564e-4134-8af0-6ff67335027d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:09.639907 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-afc44f51-564e-4134-8af0-6ff67335027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:09.796709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac06968-0470-435b-bc83-891760d87cdd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:09.813013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68759e-de80-4d9e-938a-1672fcf84668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:09.813766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68759e-de80-4d9e-938a-1672fcf84668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:09.817942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68759e-de80-4d9e-938a-1672fcf84668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:09.818811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68759e-de80-4d9e-938a-1672fcf84668 admin admin] PATH_INFO: `/v3/projects/d69e24860fe3464cb8fd7b9052d0083c/users/35ae332b9a89492ba98432c01a5fd7de/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:09.825788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 878/1748] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:09.827380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8d37-bbbe-4ff0-b373-cb5901d958c4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:09.827778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8d37-bbbe-4ff0-b373-cb5901d958c4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:09.827948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8d37-bbbe-4ff0-b373-cb5901d958c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:09.900627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68759e-de80-4d9e-938a-1672fcf84668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69e24860fe3464cb8fd7b9052d0083c, user_id=35ae332b9a89492ba98432c01a5fd7de, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:09.908501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68759e-de80-4d9e-938a-1672fcf84668 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:09.947624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e37f8d37-bbbe-4ff0-b373-cb5901d958c4 None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:09.948023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e37f8d37-bbbe-4ff0-b373-cb5901d958c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:09.954892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 871/1749] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:09 2022] PUT /identity/v3/projects/d69e24860fe3464cb8fd7b9052d0083c/users/35ae332b9a89492ba98432c01a5fd7de/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:09.956346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfeb9d-24b9-4fe5-b7a4-05e5053f027a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:09.956636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfeb9d-24b9-4fe5-b7a4-05e5053f027a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:09.956907 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfeb9d-24b9-4fe5-b7a4-05e5053f027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:09.992862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1fcfeb9d-24b9-4fe5-b7a4-05e5053f027a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:09.997291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1fcfeb9d-24b9-4fe5-b7a4-05e5053f027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:10.106237 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 879/1750] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:10.107185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f8d37-bbbe-4ff0-b373-cb5901d958c4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:10.109431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e37f8d37-bbbe-4ff0-b373-cb5901d958c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:10.230357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 872/1751] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:10.235253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfeb9d-24b9-4fe5-b7a4-05e5053f027a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:10.253160 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfeb9d-24b9-4fe5-b7a4-05e5053f027a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:10.253530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:10.261349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe6c2d-f771-4f95-b72e-e24b9cceeaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:10.263616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe6c2d-f771-4f95-b72e-e24b9cceeaca admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:10.265116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe6c2d-f771-4f95-b72e-e24b9cceeaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:10.265648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe6c2d-f771-4f95-b72e-e24b9cceeaca admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:10.266757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe6c2d-f771-4f95-b72e-e24b9cceeaca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:10.267722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe6c2d-f771-4f95-b72e-e24b9cceeaca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:10.270153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe6c2d-f771-4f95-b72e-e24b9cceeaca admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:10.294746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 873/1752] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:10.296391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe6c2d-f771-4f95-b72e-e24b9cceeaca admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:10.296868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f8d37-bbbe-4ff0-b373-cb5901d958c4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:10.303717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754886f-ded0-4f18-9840-839b8f33ec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:10.304602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754886f-ded0-4f18-9840-839b8f33ec8a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:10.304602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754886f-ded0-4f18-9840-839b8f33ec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:10.304967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754886f-ded0-4f18-9840-839b8f33ec8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:10.305774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754886f-ded0-4f18-9840-839b8f33ec8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:10.308661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe6c2d-f771-4f95-b72e-e24b9cceeaca admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:10.309360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754886f-ded0-4f18-9840-839b8f33ec8a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:10.314758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235b60f-ec0e-4e72-9607-60c4404c67c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:10.315776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b60f-ec0e-4e72-9607-60c4404c67c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:10.316281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b60f-ec0e-4e72-9607-60c4404c67c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:10.316653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b60f-ec0e-4e72-9607-60c4404c67c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:10.317583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235b60f-ec0e-4e72-9607-60c4404c67c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:10.320494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235b60f-ec0e-4e72-9607-60c4404c67c7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:10.328809 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 880/1753] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:10.334185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754886f-ded0-4f18-9840-839b8f33ec8a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:10.367987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754886f-ded0-4f18-9840-839b8f33ec8a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:10.376510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 874/1754] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:10 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:10.380678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235b60f-ec0e-4e72-9607-60c4404c67c7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:10.407735 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:10.534978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235b60f-ec0e-4e72-9607-60c4404c67c7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:10.551119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6962c-74b8-4214-9793-a47444e1298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:10.552664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6962c-74b8-4214-9793-a47444e1298d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:10.554454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6962c-74b8-4214-9793-a47444e1298d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:10.554932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6962c-74b8-4214-9793-a47444e1298d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:10.555772 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6962c-74b8-4214-9793-a47444e1298d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:10.566004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6962c-74b8-4214-9793-a47444e1298d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:10.580212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4704a58-ca14-417d-a393-f47af5c51fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:10.580910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704a58-ca14-417d-a393-f47af5c51fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:10.581218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704a58-ca14-417d-a393-f47af5c51fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:10.581503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704a58-ca14-417d-a393-f47af5c51fb6 admin admin] PATH_INFO: `/v3/projects/d69e24860fe3464cb8fd7b9052d0083c/users/35ae332b9a89492ba98432c01a5fd7de/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:10.587343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4704a58-ca14-417d-a393-f47af5c51fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69e24860fe3464cb8fd7b9052d0083c, user_id=35ae332b9a89492ba98432c01a5fd7de, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:10.590211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4704a58-ca14-417d-a393-f47af5c51fb6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:10.616752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 881/1755] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:10 2022] PUT /identity/v3/projects/d69e24860fe3464cb8fd7b9052d0083c/users/35ae332b9a89492ba98432c01a5fd7de/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:10.617716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4704a58-ca14-417d-a393-f47af5c51fb6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:10.623735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d4704a58-ca14-417d-a393-f47af5c51fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:10.636520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 875/1756] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:10 2022] POST /identity/v3/users => generated 291 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:10.637980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30748aa7-bfe9-46fb-9b4e-0a3166ef3277 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:10.641300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30748aa7-bfe9-46fb-9b4e-0a3166ef3277 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:10.641618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30748aa7-bfe9-46fb-9b4e-0a3166ef3277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:10.736460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-30748aa7-bfe9-46fb-9b4e-0a3166ef3277 None None] MFA Rules not processed for user `35ae332b9a89492ba98432c01a5fd7de`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:10.738317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-30748aa7-bfe9-46fb-9b4e-0a3166ef3277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:10.898607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4704a58-ca14-417d-a393-f47af5c51fb6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:10.916696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4995dd-5145-4a53-9a65-ae512235acfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:10.917545 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4995dd-5145-4a53-9a65-ae512235acfd service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:10.917966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4995dd-5145-4a53-9a65-ae512235acfd service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:10.918249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4995dd-5145-4a53-9a65-ae512235acfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:10.967101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 876/1757] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:10.969139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30748aa7-bfe9-46fb-9b4e-0a3166ef3277 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:11.041096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:11.049603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4995dd-5145-4a53-9a65-ae512235acfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:11.052283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4995dd-5145-4a53-9a65-ae512235acfd service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:11.072999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 882/1758] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:33:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:33:11.088533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4995dd-5145-4a53-9a65-ae512235acfd service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:11.093471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fc4995dd-5145-4a53-9a65-ae512235acfd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:11.162611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30748aa7-bfe9-46fb-9b4e-0a3166ef3277 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:11.178383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08da3f-a87f-49f5-a136-159726a7ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:11.179396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08da3f-a87f-49f5-a136-159726a7ef67 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:11.179396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08da3f-a87f-49f5-a136-159726a7ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:11.179837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08da3f-a87f-49f5-a136-159726a7ef67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:11.180821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08da3f-a87f-49f5-a136-159726a7ef67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:11.182591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08da3f-a87f-49f5-a136-159726a7ef67 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:11.200813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 877/1759] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:11.205218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08da3f-a87f-49f5-a136-159726a7ef67 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:11.229294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08da3f-a87f-49f5-a136-159726a7ef67 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:11.244159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143e777-593f-4dc0-8137-b1f0da51799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:11.244752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143e777-593f-4dc0-8137-b1f0da51799b admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:11.245177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143e777-593f-4dc0-8137-b1f0da51799b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:11.245550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143e777-593f-4dc0-8137-b1f0da51799b admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:11.246331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143e777-593f-4dc0-8137-b1f0da51799b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:11.248170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143e777-593f-4dc0-8137-b1f0da51799b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:11.282972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 878/1760] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:11.284086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143e777-593f-4dc0-8137-b1f0da51799b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:11.307693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143e777-593f-4dc0-8137-b1f0da51799b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:11.316996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb07f53-1b26-4a75-8483-cfbfad911e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:11.316996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07f53-1b26-4a75-8483-cfbfad911e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:11.316996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07f53-1b26-4a75-8483-cfbfad911e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:11.316996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb07f53-1b26-4a75-8483-cfbfad911e4b admin admin] PATH_INFO: `/v3/projects/39a102dce33a47b882c5ccc3732124f7/users/ace9dd852a7e4ca898db52d3a9d7347c/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:11.323656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:11.353022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb07f53-1b26-4a75-8483-cfbfad911e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a102dce33a47b882c5ccc3732124f7, user_id=ace9dd852a7e4ca898db52d3a9d7347c, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:11.358372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb07f53-1b26-4a75-8483-cfbfad911e4b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:11.383456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 879/1761] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:11 2022] PUT /identity/v3/projects/39a102dce33a47b882c5ccc3732124f7/users/ace9dd852a7e4ca898db52d3a9d7347c/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:11.393881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73947521-7ae6-47f0-b123-1321e007eee6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:11.394185 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73947521-7ae6-47f0-b123-1321e007eee6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:11.394436 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73947521-7ae6-47f0-b123-1321e007eee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:11.412814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4995dd-5145-4a53-9a65-ae512235acfd service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:11.452085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-73947521-7ae6-47f0-b123-1321e007eee6 None None] MFA Rules not processed for user `ace9dd852a7e4ca898db52d3a9d7347c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:11.453365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-73947521-7ae6-47f0-b123-1321e007eee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:11.487950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8753407-be50-4632-acd5-01179f8fc12d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:11.489210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8753407-be50-4632-acd5-01179f8fc12d service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:11.489879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8753407-be50-4632-acd5-01179f8fc12d service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:11.490956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8753407-be50-4632-acd5-01179f8fc12d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:11.691868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 880/1762] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:11.697789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73947521-7ae6-47f0-b123-1321e007eee6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:11.732831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8753407-be50-4632-acd5-01179f8fc12d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:11.739000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8753407-be50-4632-acd5-01179f8fc12d service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:11.790708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 883/1763] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:11.869641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8753407-be50-4632-acd5-01179f8fc12d service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:11.883967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8753407-be50-4632-acd5-01179f8fc12d service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:11.914003 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73947521-7ae6-47f0-b123-1321e007eee6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:11.922423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a407d9-ee28-409b-a247-04924d46d33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:11.923261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:11.923523 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a407d9-ee28-409b-a247-04924d46d33a admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:11.923815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a407d9-ee28-409b-a247-04924d46d33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:11.924090 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a407d9-ee28-409b-a247-04924d46d33a admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:11.924739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a407d9-ee28-409b-a247-04924d46d33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:11.925767 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:11.926193 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:11.928317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] PATH_INFO: `/v3/users/09d472fe010f435c954db3da82b21655` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:11.928627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a407d9-ee28-409b-a247-04924d46d33a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:11.935225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d472fe010f435c954db3da82b21655)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:11.937375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:12.097564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 881/1764] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:11 2022] POST /identity/v3/projects => generated 385 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:12.106895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a407d9-ee28-409b-a247-04924d46d33a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:12.133715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d472fe010f435c954db3da82b21655'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:12.138140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d472fe010f435c954db3da82b21655'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:12.181543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d472fe010f435c954db3da82b21655'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:12.183564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:12.241073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d472fe010f435c954db3da82b21655'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:12.245464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b5185943-d3b4-410e-9ecf-e3838ed37dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d472fe010f435c954db3da82b21655'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:12.301377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 884/1765] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:11 2022] DELETE /identity/v3/users/09d472fe010f435c954db3da82b21655 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:12.303254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93512aa-2f9a-47b3-9834-e461d7e3008a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:12.303551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93512aa-2f9a-47b3-9834-e461d7e3008a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:12.303835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93512aa-2f9a-47b3-9834-e461d7e3008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:12.367791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b93512aa-2f9a-47b3-9834-e461d7e3008a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:12.371654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b93512aa-2f9a-47b3-9834-e461d7e3008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:12.405136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a407d9-ee28-409b-a247-04924d46d33a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:12.426092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:12.573236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 885/1766] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:12.574617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970a8e2-902b-49b9-b8a4-20dc121b2da5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:12.574912 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970a8e2-902b-49b9-b8a4-20dc121b2da5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:12.575193 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970a8e2-902b-49b9-b8a4-20dc121b2da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:12.628628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66dbea-cb7e-4146-a77e-65895f08bd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:12.629974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66dbea-cb7e-4146-a77e-65895f08bd3d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:12.630299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66dbea-cb7e-4146-a77e-65895f08bd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:12.630648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66dbea-cb7e-4146-a77e-65895f08bd3d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:12.636074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66dbea-cb7e-4146-a77e-65895f08bd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:12.639345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66dbea-cb7e-4146-a77e-65895f08bd3d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:12.644699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8970a8e2-902b-49b9-b8a4-20dc121b2da5 None None] MFA Rules not processed for user `ad0f25125b534983af66d5326f4d626d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:12.652468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8970a8e2-902b-49b9-b8a4-20dc121b2da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:12.697933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 882/1767] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:12 2022] POST /identity/v3/users => generated 299 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:12.701304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66dbea-cb7e-4146-a77e-65895f08bd3d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:12.705755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ba66dbea-cb7e-4146-a77e-65895f08bd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:12.805123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 886/1768] 10.222.0.55 () {58 vars in 1015 bytes} [Mon Sep 26 10:33:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:12.805994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970a8e2-902b-49b9-b8a4-20dc121b2da5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:12.808414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8970a8e2-902b-49b9-b8a4-20dc121b2da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:12.847202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970a8e2-902b-49b9-b8a4-20dc121b2da5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:12.857335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efb618-c794-4549-858f-6d026f19048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:12.857981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efb618-c794-4549-858f-6d026f19048d admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:12.866331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efb618-c794-4549-858f-6d026f19048d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:12.866331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efb618-c794-4549-858f-6d026f19048d admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:12.866586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efb618-c794-4549-858f-6d026f19048d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:12.868211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efb618-c794-4549-858f-6d026f19048d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:12.888498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66dbea-cb7e-4146-a77e-65895f08bd3d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:12.899446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f14fff-a09b-481f-8c48-9c3658bc29e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:12.901268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f14fff-a09b-481f-8c48-9c3658bc29e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:12.901985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f14fff-a09b-481f-8c48-9c3658bc29e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:12.902861 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f14fff-a09b-481f-8c48-9c3658bc29e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:12.966036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 887/1769] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:12.970306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efb618-c794-4549-858f-6d026f19048d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:12.976521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f14fff-a09b-481f-8c48-9c3658bc29e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:12.977377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-12efb618-c794-4549-858f-6d026f19048d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:12.982423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f14fff-a09b-481f-8c48-9c3658bc29e2 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:13.032655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 883/1770] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:13.036017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f14fff-a09b-481f-8c48-9c3658bc29e2 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:13.043697 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efb618-c794-4549-858f-6d026f19048d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:13.087392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f14fff-a09b-481f-8c48-9c3658bc29e2 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:13.095814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:13.099800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:13.101846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:13.102362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] PATH_INFO: `/v3/projects/a2c9b273836b4a10b3ce86f475fd1c3d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:13.104441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c9b273836b4a10b3ce86f475fd1c3d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:13.125018 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62221ea-e78f-469b-ab00-19c959880c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:13.125247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:13.130660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62221ea-e78f-469b-ab00-19c959880c93 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:13.130660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62221ea-e78f-469b-ab00-19c959880c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:13.130660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62221ea-e78f-469b-ab00-19c959880c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:13.167052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62221ea-e78f-469b-ab00-19c959880c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:13.173646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62221ea-e78f-469b-ab00-19c959880c93 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:13.216759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 884/1771] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:13.219936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62221ea-e78f-469b-ab00-19c959880c93 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:13.300709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62221ea-e78f-469b-ab00-19c959880c93 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:13.330960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c9b273836b4a10b3ce86f475fd1c3d', 'request_id': 'req-a072b27d-1163-456e-a5b3-d9e8ee5042bc'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:13.375396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c9b273836b4a10b3ce86f475fd1c3d', 'request_id': 'req-a072b27d-1163-456e-a5b3-d9e8ee5042bc'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:13.407102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c9b273836b4a10b3ce86f475fd1c3d', 'request_id': 'req-a072b27d-1163-456e-a5b3-d9e8ee5042bc'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:13.416683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:13.438081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] The token cache is being invalidate because project a2c9b273836b4a10b3ce86f475fd1c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:13.438469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:13.440074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:13.448918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 888/1772] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:12 2022] DELETE /identity/v3/projects/a2c9b273836b4a10b3ce86f475fd1c3d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:13.449878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:13.451746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:13.521271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168663e-8995-45f0-9205-40d83939a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:13.522581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168663e-8995-45f0-9205-40d83939a26f admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:13.522867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168663e-8995-45f0-9205-40d83939a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:13.528876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168663e-8995-45f0-9205-40d83939a26f admin admin] PATH_INFO: `/v3/projects/7601fc459bb34df6be583a7d1061ce70/users/8cbfc4a302ce4f25906e8466638bc111/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:13.575534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168663e-8995-45f0-9205-40d83939a26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7601fc459bb34df6be583a7d1061ce70, user_id=8cbfc4a302ce4f25906e8466638bc111, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:13.584016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168663e-8995-45f0-9205-40d83939a26f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:13.627349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 885/1773] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:13 2022] PUT /identity/v3/projects/7601fc459bb34df6be583a7d1061ce70/users/8cbfc4a302ce4f25906e8466638bc111/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:13.629911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168663e-8995-45f0-9205-40d83939a26f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:13.641564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6168663e-8995-45f0-9205-40d83939a26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:13.676592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:13.746803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b27d-1163-456e-a5b3-d9e8ee5042bc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:13.802330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168663e-8995-45f0-9205-40d83939a26f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:13.845035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d05571-18c7-4867-a86e-83841e4b461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:13.845722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05571-18c7-4867-a86e-83841e4b461d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:13.846012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05571-18c7-4867-a86e-83841e4b461d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:13.856015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05571-18c7-4867-a86e-83841e4b461d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:13.864113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d05571-18c7-4867-a86e-83841e4b461d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:13.874584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d05571-18c7-4867-a86e-83841e4b461d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:13.940187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 886/1774] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:13.944660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d05571-18c7-4867-a86e-83841e4b461d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:14.004067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d05571-18c7-4867-a86e-83841e4b461d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:14.031862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406ccc8-554c-4807-9abe-f79e274fbcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:14.039263 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406ccc8-554c-4807-9abe-f79e274fbcec admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:14.039263 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406ccc8-554c-4807-9abe-f79e274fbcec admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:14.042001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406ccc8-554c-4807-9abe-f79e274fbcec admin admin] PATH_INFO: `/v3/projects/7601fc459bb34df6be583a7d1061ce70/users/8cbfc4a302ce4f25906e8466638bc111/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:14.052071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406ccc8-554c-4807-9abe-f79e274fbcec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7601fc459bb34df6be583a7d1061ce70, user_id=8cbfc4a302ce4f25906e8466638bc111, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:14.072371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406ccc8-554c-4807-9abe-f79e274fbcec admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:14.096167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:14.096167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:14.098148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:14.098148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] PATH_INFO: `/v3/users/95ea852bc3304c28adf24a03cead4074` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:14.102792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ea852bc3304c28adf24a03cead4074)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:14.110367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 887/1775] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:13 2022] PUT /identity/v3/projects/7601fc459bb34df6be583a7d1061ce70/users/8cbfc4a302ce4f25906e8466638bc111/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:14.123379 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:14.130387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aeed97-0778-4ebb-b011-a75fb1040abe None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:14.130834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aeed97-0778-4ebb-b011-a75fb1040abe None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:14.131910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aeed97-0778-4ebb-b011-a75fb1040abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:14.206511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d3aeed97-0778-4ebb-b011-a75fb1040abe None None] MFA Rules not processed for user `8cbfc4a302ce4f25906e8466638bc111`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:14.212234 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d3aeed97-0778-4ebb-b011-a75fb1040abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:14.220021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ea852bc3304c28adf24a03cead4074'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:14.221440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ea852bc3304c28adf24a03cead4074'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:14.239393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ea852bc3304c28adf24a03cead4074'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:14.264812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ea852bc3304c28adf24a03cead4074'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:14.266035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ea852bc3304c28adf24a03cead4074'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:14.304378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 889/1776] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:13 2022] DELETE /identity/v3/users/95ea852bc3304c28adf24a03cead4074 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:14.473842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 888/1777] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:14.487326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:14.489128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:14.569125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:14.683962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f11e1-1112-4c29-9260-f9f9f04d1df5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:14.695140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcff4f-c025-499b-b4bc-e1dc1d164af9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:14.696172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcff4f-c025-499b-b4bc-e1dc1d164af9 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:14.696848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcff4f-c025-499b-b4bc-e1dc1d164af9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:14.699625 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcff4f-c025-499b-b4bc-e1dc1d164af9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:14.710171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9cfcff4f-c025-499b-b4bc-e1dc1d164af9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:14.841693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcff4f-c025-499b-b4bc-e1dc1d164af9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:14.843173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcff4f-c025-499b-b4bc-e1dc1d164af9 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:14.877593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 890/1778] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:15.238280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aeed97-0778-4ebb-b011-a75fb1040abe None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:15.240336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d3aeed97-0778-4ebb-b011-a75fb1040abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:15.452450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aeed97-0778-4ebb-b011-a75fb1040abe None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:15.485320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:15.576239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:15.577056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:15.577983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:15.578447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] PATH_INFO: `/v3/projects/df19b1d3cee44d31b5cffeb2adb4b979` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:15.581397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df19b1d3cee44d31b5cffeb2adb4b979)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:15.584910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:15.801385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df19b1d3cee44d31b5cffeb2adb4b979', 'request_id': 'req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:15.829283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df19b1d3cee44d31b5cffeb2adb4b979', 'request_id': 'req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:15.870111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df19b1d3cee44d31b5cffeb2adb4b979', 'request_id': 'req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:15.910595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] The token cache is being invalidate because project df19b1d3cee44d31b5cffeb2adb4b979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:15.910943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:15.912733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:15.917670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 889/1779] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:15 2022] DELETE /identity/v3/projects/df19b1d3cee44d31b5cffeb2adb4b979 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:15.921634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcff4f-c025-499b-b4bc-e1dc1d164af9 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:15.936003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcff4f-c025-499b-b4bc-e1dc1d164af9 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:16.080136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:16.081586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:16.082165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:16.082470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] PATH_INFO: `/v3/users/35ae332b9a89492ba98432c01a5fd7de` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:16.083897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ae332b9a89492ba98432c01a5fd7de)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:16.090381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:16.179020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ae332b9a89492ba98432c01a5fd7de'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:16.182229 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ae332b9a89492ba98432c01a5fd7de'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:16.210056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ae332b9a89492ba98432c01a5fd7de'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:16.231079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ae332b9a89492ba98432c01a5fd7de'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:16.232530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ac21018e-747e-4ce5-83e8-29ff17ff5dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ae332b9a89492ba98432c01a5fd7de'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:16.241728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:16.254271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 891/1780] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:15 2022] DELETE /identity/v3/users/35ae332b9a89492ba98432c01a5fd7de => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:16.917324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:16.934796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:16.960454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ec452-7a0a-4c33-a5cb-379cf9ee6c53 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:17.112307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e681a-2173-45eb-9703-0ab297de519f None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:17.112870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e681a-2173-45eb-9703-0ab297de519f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:17.112870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e681a-2173-45eb-9703-0ab297de519f None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:17.116356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 892/1781] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:33:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:33:17.154375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:17.155038 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:17.155320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:17.155843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] PATH_INFO: `/v3/projects/a04182873bca45e7a214f68b1017b30d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:17.165397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04182873bca45e7a214f68b1017b30d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:17.168778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:17.312218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca361781-a64d-48fb-978b-f795572c17d2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:17.312847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca361781-a64d-48fb-978b-f795572c17d2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:17.313368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca361781-a64d-48fb-978b-f795572c17d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:17.315970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04182873bca45e7a214f68b1017b30d', 'request_id': 'req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:17.343552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04182873bca45e7a214f68b1017b30d', 'request_id': 'req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:17.356015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:17.363906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04182873bca45e7a214f68b1017b30d', 'request_id': 'req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:17.370189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ca361781-a64d-48fb-978b-f795572c17d2 None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:17.390174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ca361781-a64d-48fb-978b-f795572c17d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:17.425017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] The token cache is being invalidate because project a04182873bca45e7a214f68b1017b30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:17.427287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:17.431748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a95bfb3b-d2e4-4eeb-bf59-117bd5d1f0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:17.437752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 890/1782] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:16 2022] DELETE /identity/v3/projects/a04182873bca45e7a214f68b1017b30d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:17.445126 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4986ac-2ef6-4d37-90fb-e38ad25f9ad5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:17.445568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4986ac-2ef6-4d37-90fb-e38ad25f9ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:17.445869 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4986ac-2ef6-4d37-90fb-e38ad25f9ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:17.539859 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5d4986ac-2ef6-4d37-90fb-e38ad25f9ad5 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:17.539859 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d4986ac-2ef6-4d37-90fb-e38ad25f9ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:17.678899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 893/1783] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:33:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:17.747694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 891/1784] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:17.757331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d72e-3afd-4e6f-a2e4-cb25759d83cb None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:17.757505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d72e-3afd-4e6f-a2e4-cb25759d83cb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:17.757786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d72e-3afd-4e6f-a2e4-cb25759d83cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:17.764272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4986ac-2ef6-4d37-90fb-e38ad25f9ad5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:17.766130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d4986ac-2ef6-4d37-90fb-e38ad25f9ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:17.807708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4986ac-2ef6-4d37-90fb-e38ad25f9ad5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:17.825304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f995e1c-9c03-417e-936b-340b43835b93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:17.826116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f995e1c-9c03-417e-936b-340b43835b93 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:17.826651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f995e1c-9c03-417e-936b-340b43835b93 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:17.827256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f995e1c-9c03-417e-936b-340b43835b93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:17.836291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3f84d72e-3afd-4e6f-a2e4-cb25759d83cb None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:17.837980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3f84d72e-3afd-4e6f-a2e4-cb25759d83cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:17.876154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f995e1c-9c03-417e-936b-340b43835b93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:17.883734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f995e1c-9c03-417e-936b-340b43835b93 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:17.891387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 894/1785] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:17.904089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84d72e-3afd-4e6f-a2e4-cb25759d83cb None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:17.928825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84d72e-3afd-4e6f-a2e4-cb25759d83cb None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:17.957495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 892/1786] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:17.960704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d06f48-6614-431e-96fa-38bdff361f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:17.966471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d06f48-6614-431e-96fa-38bdff361f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:17.968863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d06f48-6614-431e-96fa-38bdff361f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:17.973292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d06f48-6614-431e-96fa-38bdff361f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:17.975550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d06f48-6614-431e-96fa-38bdff361f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:17.979632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f995e1c-9c03-417e-936b-340b43835b93 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:17.980203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d06f48-6614-431e-96fa-38bdff361f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:17.982386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9f995e1c-9c03-417e-936b-340b43835b93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:17.986744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d06f48-6614-431e-96fa-38bdff361f80 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:18.047133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f995e1c-9c03-417e-936b-340b43835b93 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:18.062137 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:18.062897 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.063346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.063624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] PATH_INFO: `/v3/projects/d69e24860fe3464cb8fd7b9052d0083c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.066216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 895/1787] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:33:18.067381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d06f48-6614-431e-96fa-38bdff361f80 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:18.073997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69e24860fe3464cb8fd7b9052d0083c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:18.082243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:18.123291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d06f48-6614-431e-96fa-38bdff361f80 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:18.155149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb4d3-64ee-43d2-a348-9f84d77d60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:18.164249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb4d3-64ee-43d2-a348-9f84d77d60f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.164249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb4d3-64ee-43d2-a348-9f84d77d60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.164249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb4d3-64ee-43d2-a348-9f84d77d60f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.164249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eb4d3-64ee-43d2-a348-9f84d77d60f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:18.164249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eb4d3-64ee-43d2-a348-9f84d77d60f9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:18.239124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 896/1788] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:18 2022] POST /identity/v3/projects => generated 391 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:18.245021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb4d3-64ee-43d2-a348-9f84d77d60f9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:18.274843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69e24860fe3464cb8fd7b9052d0083c', 'request_id': 'req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:18.299604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69e24860fe3464cb8fd7b9052d0083c', 'request_id': 'req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:18.325905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69e24860fe3464cb8fd7b9052d0083c', 'request_id': 'req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:18.343888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] The token cache is being invalidate because project d69e24860fe3464cb8fd7b9052d0083c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:18.344365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:18.345260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f9d9d2e0-c8b0-488d-bf62-5a0afa994539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:18.347421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 893/1789] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:17 2022] DELETE /identity/v3/projects/d69e24860fe3464cb8fd7b9052d0083c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:18.359134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110de7f-efbe-4c98-aee9-b2d5c8517232 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.359134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110de7f-efbe-4c98-aee9-b2d5c8517232 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.359134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110de7f-efbe-4c98-aee9-b2d5c8517232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.416454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb4d3-64ee-43d2-a348-9f84d77d60f9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:18.423065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bf1d5-2b7e-4ac0-ada1-24bb14eac069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:18.423690 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bf1d5-2b7e-4ac0-ada1-24bb14eac069 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.424227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bf1d5-2b7e-4ac0-ada1-24bb14eac069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.424935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bf1d5-2b7e-4ac0-ada1-24bb14eac069 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.425181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bf1d5-2b7e-4ac0-ada1-24bb14eac069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:18.427401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bf1d5-2b7e-4ac0-ada1-24bb14eac069 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:18.432145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c110de7f-efbe-4c98-aee9-b2d5c8517232 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:18.439210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c110de7f-efbe-4c98-aee9-b2d5c8517232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:18.463351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 897/1790] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:18 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:18.467766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bf1d5-2b7e-4ac0-ada1-24bb14eac069 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:18.471762 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e76bf1d5-2b7e-4ac0-ada1-24bb14eac069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:18.488383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 894/1791] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:18.490717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279fece-e0ed-4d98-96bd-ef1c727ae098 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.491097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279fece-e0ed-4d98-96bd-ef1c727ae098 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.491480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279fece-e0ed-4d98-96bd-ef1c727ae098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.513032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bf1d5-2b7e-4ac0-ada1-24bb14eac069 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:18.527380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6280c7c-8e85-4da3-938c-8c8cdcd68c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:18.529410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6280c7c-8e85-4da3-938c-8c8cdcd68c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.529693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6280c7c-8e85-4da3-938c-8c8cdcd68c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.529971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6280c7c-8e85-4da3-938c-8c8cdcd68c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.530662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6280c7c-8e85-4da3-938c-8c8cdcd68c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:18.535045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6280c7c-8e85-4da3-938c-8c8cdcd68c35 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:18.574155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9279fece-e0ed-4d98-96bd-ef1c727ae098 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:18.579497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9279fece-e0ed-4d98-96bd-ef1c727ae098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:18.587560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 898/1792] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:18.590342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6280c7c-8e85-4da3-938c-8c8cdcd68c35 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:18.614836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 895/1793] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:18.619233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279fece-e0ed-4d98-96bd-ef1c727ae098 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:18.643337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6280c7c-8e85-4da3-938c-8c8cdcd68c35 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:18.643820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279fece-e0ed-4d98-96bd-ef1c727ae098 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:18.655588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8140f-ffd7-4637-9e79-2e4c347e614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:18.660663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8140f-ffd7-4637-9e79-2e4c347e614b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.661006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8140f-ffd7-4637-9e79-2e4c347e614b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.661286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8140f-ffd7-4637-9e79-2e4c347e614b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.662038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8140f-ffd7-4637-9e79-2e4c347e614b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:18.664450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ef9b1-c7cb-410d-8683-604ff7eea724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:18.666104 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef9b1-c7cb-410d-8683-604ff7eea724 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.666949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef9b1-c7cb-410d-8683-604ff7eea724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.667370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef9b1-c7cb-410d-8683-604ff7eea724 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.668863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ef9b1-c7cb-410d-8683-604ff7eea724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:18.669770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8140f-ffd7-4637-9e79-2e4c347e614b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:18.673084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ef9b1-c7cb-410d-8683-604ff7eea724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:18.675220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ef9b1-c7cb-410d-8683-604ff7eea724 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:18.706191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 899/1794] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:18.706552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8140f-ffd7-4637-9e79-2e4c347e614b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:18.717159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 896/1795] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:33:18.719035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ef9b1-c7cb-410d-8683-604ff7eea724 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:18.744462 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8140f-ffd7-4637-9e79-2e4c347e614b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:18.751392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ef9b1-c7cb-410d-8683-604ff7eea724 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:18.752122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afb44-f75c-469a-92b0-feb1827eb051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:18.752870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afb44-f75c-469a-92b0-feb1827eb051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.753204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afb44-f75c-469a-92b0-feb1827eb051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.753479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afb44-f75c-469a-92b0-feb1827eb051 admin admin] PATH_INFO: `/v3/projects/ef76d7dccd254cd6b5f70f87f4c35fde/users/749c0c67ccd64799a6f144eab832f3af/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.768143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9591-b3c0-4ebb-b6e7-8cf0cec1f76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:18.768911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9591-b3c0-4ebb-b6e7-8cf0cec1f76e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.769238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9591-b3c0-4ebb-b6e7-8cf0cec1f76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.769603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9591-b3c0-4ebb-b6e7-8cf0cec1f76e admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.770371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9591-b3c0-4ebb-b6e7-8cf0cec1f76e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:18.777026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9591-b3c0-4ebb-b6e7-8cf0cec1f76e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:18.785213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:18.802578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874afb44-f75c-469a-92b0-feb1827eb051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef76d7dccd254cd6b5f70f87f4c35fde, user_id=749c0c67ccd64799a6f144eab832f3af, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:18.805724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874afb44-f75c-469a-92b0-feb1827eb051 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:18.844426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 897/1797] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:18 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:18.845852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877605e-9beb-4038-a14e-474c3853a8ad None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:18.846146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877605e-9beb-4038-a14e-474c3853a8ad None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:18.846412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877605e-9beb-4038-a14e-474c3853a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:18.848280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 900/1797] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:18 2022] PUT /identity/v3/projects/ef76d7dccd254cd6b5f70f87f4c35fde/users/749c0c67ccd64799a6f144eab832f3af/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:18.849471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afb44-f75c-469a-92b0-feb1827eb051 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:18.892312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:18.920513 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6877605e-9beb-4038-a14e-474c3853a8ad None None] MFA Rules not processed for user `e0589d6270464a4c8f5ed7680ca48164`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:18.921788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6877605e-9beb-4038-a14e-474c3853a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:19.017039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afb44-f75c-469a-92b0-feb1827eb051 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:19.045702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 898/1798] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:19.047563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c125bb-79d8-4797-ad5b-3a8002d83123 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:19.047563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c125bb-79d8-4797-ad5b-3a8002d83123 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:19.047727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c125bb-79d8-4797-ad5b-3a8002d83123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:19.198806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-65c125bb-79d8-4797-ad5b-3a8002d83123 None None] MFA Rules not processed for user `749c0c67ccd64799a6f144eab832f3af`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:19.208352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-65c125bb-79d8-4797-ad5b-3a8002d83123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:19.279242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d75dc-141c-4d2d-97e6-2e77f46f68d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:19.279799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d75dc-141c-4d2d-97e6-2e77f46f68d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:19.279799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d75dc-141c-4d2d-97e6-2e77f46f68d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:19.279985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d75dc-141c-4d2d-97e6-2e77f46f68d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:19.280601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d75dc-141c-4d2d-97e6-2e77f46f68d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:19.295916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d75dc-141c-4d2d-97e6-2e77f46f68d9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:19.391197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 901/1799] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:18 2022] POST /identity/v3/users => generated 289 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:19.398949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d75dc-141c-4d2d-97e6-2e77f46f68d9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:19.440182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d75dc-141c-4d2d-97e6-2e77f46f68d9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:19.457536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81333af-e163-4d42-882a-325af70b15b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:19.458180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81333af-e163-4d42-882a-325af70b15b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:19.458539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81333af-e163-4d42-882a-325af70b15b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:19.458891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81333af-e163-4d42-882a-325af70b15b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:19.461305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81333af-e163-4d42-882a-325af70b15b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:19.466634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81333af-e163-4d42-882a-325af70b15b4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:19.498426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 899/1800] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:19.502352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c125bb-79d8-4797-ad5b-3a8002d83123 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:19.510697 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 902/1801] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:19.515573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81333af-e163-4d42-882a-325af70b15b4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:19.533976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c125bb-79d8-4797-ad5b-3a8002d83123 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:19.540158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81333af-e163-4d42-882a-325af70b15b4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:19.548629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67f071-1415-4762-a23b-305629c7d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:19.549497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67f071-1415-4762-a23b-305629c7d055 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:19.549826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67f071-1415-4762-a23b-305629c7d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:19.550195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67f071-1415-4762-a23b-305629c7d055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:19.550968 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67f071-1415-4762-a23b-305629c7d055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:19.553773 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0ce83-bb18-4507-bc45-e9d448fb0e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:19.555655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ce83-bb18-4507-bc45-e9d448fb0e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:19.557508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ce83-bb18-4507-bc45-e9d448fb0e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:19.557986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67f071-1415-4762-a23b-305629c7d055 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:19.558853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ce83-bb18-4507-bc45-e9d448fb0e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:19.559881 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0ce83-bb18-4507-bc45-e9d448fb0e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:19.565345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0ce83-bb18-4507-bc45-e9d448fb0e2f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:19.604135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 903/1802] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:19.606718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0ce83-bb18-4507-bc45-e9d448fb0e2f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:19.623597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 900/1803] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:19 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:19.627380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67f071-1415-4762-a23b-305629c7d055 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:19.644696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0ce83-bb18-4507-bc45-e9d448fb0e2f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:19.799794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67f071-1415-4762-a23b-305629c7d055 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:19.821552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152c539-5e15-4109-8a11-680273f0e6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:19.822924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c539-5e15-4109-8a11-680273f0e6ea admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:19.823697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c539-5e15-4109-8a11-680273f0e6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:19.824293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c539-5e15-4109-8a11-680273f0e6ea admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:19.825189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152c539-5e15-4109-8a11-680273f0e6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:19.827364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152c539-5e15-4109-8a11-680273f0e6ea admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:19.917686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 901/1804] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:19 2022] POST /identity/v3/users => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:19.918712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152c539-5e15-4109-8a11-680273f0e6ea admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:19.958863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98eef9-b7fe-4c03-9c4d-65ac99dbba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:19.959777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152c539-5e15-4109-8a11-680273f0e6ea admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:19.964301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98eef9-b7fe-4c03-9c4d-65ac99dbba99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:19.966731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98eef9-b7fe-4c03-9c4d-65ac99dbba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:19.983472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98eef9-b7fe-4c03-9c4d-65ac99dbba99 admin admin] PATH_INFO: `/v3/projects/f9afe26e46bc474a95cdc473a17a2157/users/3020d9222d004eb98da0ad7697b28d42/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:19.994809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279b276-7fe3-4075-9e02-88e7e417aa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:19.995441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279b276-7fe3-4075-9e02-88e7e417aa75 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:19.995724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279b276-7fe3-4075-9e02-88e7e417aa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:19.995999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279b276-7fe3-4075-9e02-88e7e417aa75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:19.996656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279b276-7fe3-4075-9e02-88e7e417aa75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:20.001099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279b276-7fe3-4075-9e02-88e7e417aa75 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:20.003826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:20.020731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:20.043268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 902/1805] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:20.044097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279b276-7fe3-4075-9e02-88e7e417aa75 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:20.056988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279b276-7fe3-4075-9e02-88e7e417aa75 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:20.058829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98eef9-b7fe-4c03-9c4d-65ac99dbba99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9afe26e46bc474a95cdc473a17a2157, user_id=3020d9222d004eb98da0ad7697b28d42, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:20.064122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98eef9-b7fe-4c03-9c4d-65ac99dbba99 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:20.065677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9faf4-6c49-4843-84e7-dcfbd9aeccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:20.070630 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9faf4-6c49-4843-84e7-dcfbd9aeccf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:20.071799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9faf4-6c49-4843-84e7-dcfbd9aeccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:20.094979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9faf4-6c49-4843-84e7-dcfbd9aeccf3 admin admin] PATH_INFO: `/v3/projects/4cf4bab4f8254217becc75bf939033ef/users/d7c0dfdf2b014c00887b06ba910e3545/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:20.112218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 904/1806] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:19 2022] PUT /identity/v3/projects/f9afe26e46bc474a95cdc473a17a2157/users/3020d9222d004eb98da0ad7697b28d42/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:20.122380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e241b-8ef8-4ad1-a3af-7135ab1e8ffc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:20.122659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e241b-8ef8-4ad1-a3af-7135ab1e8ffc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:20.123074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e241b-8ef8-4ad1-a3af-7135ab1e8ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:20.158946 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9faf4-6c49-4843-84e7-dcfbd9aeccf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf4bab4f8254217becc75bf939033ef, user_id=d7c0dfdf2b014c00887b06ba910e3545, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:20.161966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9faf4-6c49-4843-84e7-dcfbd9aeccf3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:20.215874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4e7e241b-8ef8-4ad1-a3af-7135ab1e8ffc None None] MFA Rules not processed for user `3020d9222d004eb98da0ad7697b28d42`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:20.219753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4e7e241b-8ef8-4ad1-a3af-7135ab1e8ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:20.231593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 903/1807] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:20 2022] PUT /identity/v3/projects/4cf4bab4f8254217becc75bf939033ef/users/d7c0dfdf2b014c00887b06ba910e3545/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:20.232709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9faf4-6c49-4843-84e7-dcfbd9aeccf3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:20.399758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 905/1808] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:20.404202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e241b-8ef8-4ad1-a3af-7135ab1e8ffc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:20.454187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9faf4-6c49-4843-84e7-dcfbd9aeccf3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:20.462965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1b3dc-7872-47a5-ace7-ee8d970a5c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:20.463642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b3dc-7872-47a5-ace7-ee8d970a5c39 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:20.463924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b3dc-7872-47a5-ace7-ee8d970a5c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:20.464252 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b3dc-7872-47a5-ace7-ee8d970a5c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:20.465474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1b3dc-7872-47a5-ace7-ee8d970a5c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:20.468099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1b3dc-7872-47a5-ace7-ee8d970a5c39 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:20.481965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 904/1809] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:20.486850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1b3dc-7872-47a5-ace7-ee8d970a5c39 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:20.501452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1b3dc-7872-47a5-ace7-ee8d970a5c39 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:20.508861 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619c206-0ae9-40bb-8277-77757a33aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:20.509744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619c206-0ae9-40bb-8277-77757a33aa90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:20.510034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619c206-0ae9-40bb-8277-77757a33aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:20.510309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619c206-0ae9-40bb-8277-77757a33aa90 admin admin] PATH_INFO: `/v3/projects/4cf4bab4f8254217becc75bf939033ef/users/d7c0dfdf2b014c00887b06ba910e3545/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:20.513053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619c206-0ae9-40bb-8277-77757a33aa90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf4bab4f8254217becc75bf939033ef, user_id=d7c0dfdf2b014c00887b06ba910e3545, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:20.517295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619c206-0ae9-40bb-8277-77757a33aa90 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:20.532499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 905/1810] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:20 2022] PUT /identity/v3/projects/4cf4bab4f8254217becc75bf939033ef/users/d7c0dfdf2b014c00887b06ba910e3545/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:20.544430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc58acf-b998-412b-81f0-8cd1e1e8ac93 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:20.544719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc58acf-b998-412b-81f0-8cd1e1e8ac93 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:20.545115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc58acf-b998-412b-81f0-8cd1e1e8ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:20.553845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e241b-8ef8-4ad1-a3af-7135ab1e8ffc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:20.609691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7dc58acf-b998-412b-81f0-8cd1e1e8ac93 None None] MFA Rules not processed for user `d7c0dfdf2b014c00887b06ba910e3545`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:20.611672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7dc58acf-b998-412b-81f0-8cd1e1e8ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:20.691095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e3a8-3ffb-4e1c-90f8-7903ac9f6c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:20.692322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e3a8-3ffb-4e1c-90f8-7903ac9f6c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:20.692843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e3a8-3ffb-4e1c-90f8-7903ac9f6c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:20.693353 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e3a8-3ffb-4e1c-90f8-7903ac9f6c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:20.695411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28e3a8-3ffb-4e1c-90f8-7903ac9f6c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:20.697947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28e3a8-3ffb-4e1c-90f8-7903ac9f6c06 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:20.750327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 906/1811] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:20 2022] POST /identity/v3/projects => generated 379 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:20.757895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e3a8-3ffb-4e1c-90f8-7903ac9f6c06 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:20.776978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:20.798563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 906/1812] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:20.808705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc58acf-b998-412b-81f0-8cd1e1e8ac93 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:20.809690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7dc58acf-b998-412b-81f0-8cd1e1e8ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:20.926485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e3a8-3ffb-4e1c-90f8-7903ac9f6c06 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:20.938883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:20.941768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aed67-6a4b-467a-99ca-77e6fa523527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:20.942560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aed67-6a4b-467a-99ca-77e6fa523527 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:20.942965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aed67-6a4b-467a-99ca-77e6fa523527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:20.943317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aed67-6a4b-467a-99ca-77e6fa523527 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:20.945511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aed67-6a4b-467a-99ca-77e6fa523527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:20.951163 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aed67-6a4b-467a-99ca-77e6fa523527 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:20.977401 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc58acf-b998-412b-81f0-8cd1e1e8ac93 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:21.004716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 907/1813] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:20 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:21.006758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aed67-6a4b-467a-99ca-77e6fa523527 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:21.033055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aed67-6a4b-467a-99ca-77e6fa523527 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:21.046616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2983a3-f4f1-4e52-99a3-6839fdcd85e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:21.047277 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2983a3-f4f1-4e52-99a3-6839fdcd85e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:21.047559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2983a3-f4f1-4e52-99a3-6839fdcd85e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:21.047831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2983a3-f4f1-4e52-99a3-6839fdcd85e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:21.048519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2983a3-f4f1-4e52-99a3-6839fdcd85e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:21.050243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2983a3-f4f1-4e52-99a3-6839fdcd85e8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:21.088641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 908/1814] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:21.090588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2983a3-f4f1-4e52-99a3-6839fdcd85e8 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:21.115986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2983a3-f4f1-4e52-99a3-6839fdcd85e8 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:21.127218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef4641-06aa-41cf-9eb1-d0f2ebd5123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:21.127976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef4641-06aa-41cf-9eb1-d0f2ebd5123a admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:21.128275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef4641-06aa-41cf-9eb1-d0f2ebd5123a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:21.128567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef4641-06aa-41cf-9eb1-d0f2ebd5123a admin admin] PATH_INFO: `/v3/projects/edee9b3420314ad280bafa80ebda5ef0/users/90bf321c37c6458da626b84384315d2c/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:21.168731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef4641-06aa-41cf-9eb1-d0f2ebd5123a admin admin] RBAC: Authorizing `identity:create_grant(project_id=edee9b3420314ad280bafa80ebda5ef0, user_id=90bf321c37c6458da626b84384315d2c, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:21.171479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef4641-06aa-41cf-9eb1-d0f2ebd5123a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:21.186275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db34f1-ed37-4ee0-9b5b-59e476395bbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:21.188714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db34f1-ed37-4ee0-9b5b-59e476395bbb service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:21.191601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db34f1-ed37-4ee0-9b5b-59e476395bbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:21.191858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db34f1-ed37-4ee0-9b5b-59e476395bbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:21.201672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 909/1815] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:21 2022] PUT /identity/v3/projects/edee9b3420314ad280bafa80ebda5ef0/users/90bf321c37c6458da626b84384315d2c/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:21.202976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef4641-06aa-41cf-9eb1-d0f2ebd5123a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:21.371907 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef4641-06aa-41cf-9eb1-d0f2ebd5123a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:21.392849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ae4ba-9256-49bf-840f-e45d359774a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:21.393220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ae4ba-9256-49bf-840f-e45d359774a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:21.393673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ae4ba-9256-49bf-840f-e45d359774a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:21.395079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ae4ba-9256-49bf-840f-e45d359774a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:21.396551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ae4ba-9256-49bf-840f-e45d359774a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:21.406107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ae4ba-9256-49bf-840f-e45d359774a7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:21.425033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db34f1-ed37-4ee0-9b5b-59e476395bbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:21.429919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db34f1-ed37-4ee0-9b5b-59e476395bbb service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:21.442350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 910/1816] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:21.446476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ae4ba-9256-49bf-840f-e45d359774a7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:21.467653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ae4ba-9256-49bf-840f-e45d359774a7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:21.475173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 907/1817] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:21.479437 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ad1c8-997e-46d1-a4e5-027fa11ec4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:21.480384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ad1c8-997e-46d1-a4e5-027fa11ec4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:21.480681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ad1c8-997e-46d1-a4e5-027fa11ec4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:21.480979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ad1c8-997e-46d1-a4e5-027fa11ec4ce admin admin] PATH_INFO: `/v3/projects/edee9b3420314ad280bafa80ebda5ef0/users/90bf321c37c6458da626b84384315d2c/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:21.482980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ad1c8-997e-46d1-a4e5-027fa11ec4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=edee9b3420314ad280bafa80ebda5ef0, user_id=90bf321c37c6458da626b84384315d2c, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:21.486951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ad1c8-997e-46d1-a4e5-027fa11ec4ce admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:21.496646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db34f1-ed37-4ee0-9b5b-59e476395bbb service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:21.501145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-23db34f1-ed37-4ee0-9b5b-59e476395bbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:21.519822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db34f1-ed37-4ee0-9b5b-59e476395bbb service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:21.539091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 911/1818] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:21 2022] PUT /identity/v3/projects/edee9b3420314ad280bafa80ebda5ef0/users/90bf321c37c6458da626b84384315d2c/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:21.553677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09678a-9309-4897-8070-7bfdab412307 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:21.553988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09678a-9309-4897-8070-7bfdab412307 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:21.554266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09678a-9309-4897-8070-7bfdab412307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:21.644615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd567d0-95f0-4bb1-98fd-6efbcccf3688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:21.645304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd567d0-95f0-4bb1-98fd-6efbcccf3688 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:21.645587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd567d0-95f0-4bb1-98fd-6efbcccf3688 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:21.645860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd567d0-95f0-4bb1-98fd-6efbcccf3688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:21.651418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8cd567d0-95f0-4bb1-98fd-6efbcccf3688 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:21.669055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0e09678a-9309-4897-8070-7bfdab412307 None None] MFA Rules not processed for user `90bf321c37c6458da626b84384315d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:21.671026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0e09678a-9309-4897-8070-7bfdab412307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:21.757487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:21.833750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd567d0-95f0-4bb1-98fd-6efbcccf3688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:21.835610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd567d0-95f0-4bb1-98fd-6efbcccf3688 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:21.840901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:21.864489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 908/1819] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:21.865478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd567d0-95f0-4bb1-98fd-6efbcccf3688 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:21.891091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 912/1820] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:21.891200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd567d0-95f0-4bb1-98fd-6efbcccf3688 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:21.897805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ab31-be4d-41b2-a8a6-e66482b9c742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:21.898625 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ab31-be4d-41b2-a8a6-e66482b9c742 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:21.899366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ab31-be4d-41b2-a8a6-e66482b9c742 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:21.900020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ab31-be4d-41b2-a8a6-e66482b9c742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:22.048921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005ab31-be4d-41b2-a8a6-e66482b9c742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:22.050610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005ab31-be4d-41b2-a8a6-e66482b9c742 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:22.079781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 909/1821] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:22.502693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09678a-9309-4897-8070-7bfdab412307 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:22.516992 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09678a-9309-4897-8070-7bfdab412307 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:22.526831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd03eb-aa37-4403-8aca-ce252d0a522c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:22.527553 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd03eb-aa37-4403-8aca-ce252d0a522c service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:22.527857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd03eb-aa37-4403-8aca-ce252d0a522c service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:22.528188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd03eb-aa37-4403-8aca-ce252d0a522c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:22.723779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd03eb-aa37-4403-8aca-ce252d0a522c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:22.726165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd03eb-aa37-4403-8aca-ce252d0a522c service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:22.754551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 913/1822] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:24.760161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ab31-be4d-41b2-a8a6-e66482b9c742 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:24.770465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ab31-be4d-41b2-a8a6-e66482b9c742 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:24.774500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ee11e-3d29-4d75-8dd3-574a2ebdb9b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:24.775159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ee11e-3d29-4d75-8dd3-574a2ebdb9b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:24.775435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ee11e-3d29-4d75-8dd3-574a2ebdb9b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:24.775730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ee11e-3d29-4d75-8dd3-574a2ebdb9b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:24.785526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ee11e-3d29-4d75-8dd3-574a2ebdb9b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:24.786996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ee11e-3d29-4d75-8dd3-574a2ebdb9b4 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:24.811308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 910/1823] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:25.289166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326972d-14f6-47d2-ba13-ce8f2a1d2814 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:25.289719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326972d-14f6-47d2-ba13-ce8f2a1d2814 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:25.289719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326972d-14f6-47d2-ba13-ce8f2a1d2814 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:25.291058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 914/1824] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:33:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:33:25.322178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517728e9-284f-4b64-8f08-254cd4783134 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:25.323075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517728e9-284f-4b64-8f08-254cd4783134 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:25.323609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517728e9-284f-4b64-8f08-254cd4783134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:25.359047 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-517728e9-284f-4b64-8f08-254cd4783134 None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:25.361034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-517728e9-284f-4b64-8f08-254cd4783134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:25.556032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 911/1825] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:25.575109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326972d-14f6-47d2-ba13-ce8f2a1d2814 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:25.576863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e326972d-14f6-47d2-ba13-ce8f2a1d2814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:25.633862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326972d-14f6-47d2-ba13-ce8f2a1d2814 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:25.641980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34f535-45b0-4871-bd57-2f1bda74170d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:25.643070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34f535-45b0-4871-bd57-2f1bda74170d service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:25.643491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34f535-45b0-4871-bd57-2f1bda74170d service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:25.645423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34f535-45b0-4871-bd57-2f1bda74170d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:25.664857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34f535-45b0-4871-bd57-2f1bda74170d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:25.666727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34f535-45b0-4871-bd57-2f1bda74170d service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:25.695469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 915/1826] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:26.972995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517728e9-284f-4b64-8f08-254cd4783134 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:27.055937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517728e9-284f-4b64-8f08-254cd4783134 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:27.086258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:27.087061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:27.087395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:27.087611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] PATH_INFO: `/v3/users/749c0c67ccd64799a6f144eab832f3af` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:27.089062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] RBAC: Authorizing `identity:delete_user(user_id=749c0c67ccd64799a6f144eab832f3af)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:27.091383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:27.125544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:27.165481 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749c0c67ccd64799a6f144eab832f3af'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:27.177619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749c0c67ccd64799a6f144eab832f3af'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:27.178246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749c0c67ccd64799a6f144eab832f3af'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:27.187711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749c0c67ccd64799a6f144eab832f3af'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:27.201282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749c0c67ccd64799a6f144eab832f3af'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:27.208144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 912/1827] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:26 2022] DELETE /identity/v3/users/749c0c67ccd64799a6f144eab832f3af => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:27.212679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aee341-7975-436c-81b4-c7a1e41e1027 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:27.213239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aee341-7975-436c-81b4-c7a1e41e1027 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:27.213239 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aee341-7975-436c-81b4-c7a1e41e1027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:27.235699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-54aee341-7975-436c-81b4-c7a1e41e1027 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:27.239105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-54aee341-7975-436c-81b4-c7a1e41e1027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:27.306201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 916/1828] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:27.323996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:27.327525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:27.416524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f3993-4575-4f7c-b371-2e9d7494007e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:27.420747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594015a-986b-4638-936f-424f5528738e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:27.421508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594015a-986b-4638-936f-424f5528738e service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:27.421976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594015a-986b-4638-936f-424f5528738e service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:27.422435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594015a-986b-4638-936f-424f5528738e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:27.434735 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594015a-986b-4638-936f-424f5528738e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:27.436284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594015a-986b-4638-936f-424f5528738e service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:27.447172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 913/1829] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:27.747687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aee341-7975-436c-81b4-c7a1e41e1027 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:27.749265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-54aee341-7975-436c-81b4-c7a1e41e1027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:27.765616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aee341-7975-436c-81b4-c7a1e41e1027 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:27.771727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:27.773143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:27.773555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:27.773974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] PATH_INFO: `/v3/projects/ef76d7dccd254cd6b5f70f87f4c35fde` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:27.775349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef76d7dccd254cd6b5f70f87f4c35fde)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:27.777569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:27.834308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef76d7dccd254cd6b5f70f87f4c35fde', 'request_id': 'req-0fed2e17-5eea-473d-8315-3e0056f966ef'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:27.836821 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:27.845081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef76d7dccd254cd6b5f70f87f4c35fde', 'request_id': 'req-0fed2e17-5eea-473d-8315-3e0056f966ef'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:27.863493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef76d7dccd254cd6b5f70f87f4c35fde', 'request_id': 'req-0fed2e17-5eea-473d-8315-3e0056f966ef'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:27.886647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] The token cache is being invalidate because project ef76d7dccd254cd6b5f70f87f4c35fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:27.886950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:27.889842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:27.895528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 917/1830] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:27 2022] DELETE /identity/v3/projects/ef76d7dccd254cd6b5f70f87f4c35fde => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:27.897828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594015a-986b-4638-936f-424f5528738e service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:27.922570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594015a-986b-4638-936f-424f5528738e service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:28.035809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:28.037488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:28.038881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:28.039730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] PATH_INFO: `/v3/users/d7c0dfdf2b014c00887b06ba910e3545` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:28.040938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c0dfdf2b014c00887b06ba910e3545)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:28.042963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:28.098998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:28.107278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c0dfdf2b014c00887b06ba910e3545'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.118373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c0dfdf2b014c00887b06ba910e3545'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.119124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c0dfdf2b014c00887b06ba910e3545'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.128429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c0dfdf2b014c00887b06ba910e3545'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.144525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c0dfdf2b014c00887b06ba910e3545'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.155195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 914/1831] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:27 2022] DELETE /identity/v3/users/d7c0dfdf2b014c00887b06ba910e3545 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:28.162225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:28.164303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:28.178852 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed2e17-5eea-473d-8315-3e0056f966ef admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:28.314599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:28.317152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:28.318167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:28.318785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] PATH_INFO: `/v3/users/ace9dd852a7e4ca898db52d3a9d7347c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:28.324103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace9dd852a7e4ca898db52d3a9d7347c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:28.324245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:28.325806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:28.326546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:28.349803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba83a-7aa6-4939-ad91-c119ad727f62 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:28.356505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:28.357639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:28.358112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:28.358667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] PATH_INFO: `/v3/users/3020d9222d004eb98da0ad7697b28d42` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:28.360349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3020d9222d004eb98da0ad7697b28d42)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:28.363651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:28.430627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace9dd852a7e4ca898db52d3a9d7347c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.432452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace9dd852a7e4ca898db52d3a9d7347c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.443977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace9dd852a7e4ca898db52d3a9d7347c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.471660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3020d9222d004eb98da0ad7697b28d42'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.480679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace9dd852a7e4ca898db52d3a9d7347c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.481558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-14bb37a6-de0b-4910-a1c8-e1b12ed13112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace9dd852a7e4ca898db52d3a9d7347c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.483964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3020d9222d004eb98da0ad7697b28d42'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.485273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3020d9222d004eb98da0ad7697b28d42'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.500780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3020d9222d004eb98da0ad7697b28d42'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.509057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 918/1832] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:28 2022] DELETE /identity/v3/users/ace9dd852a7e4ca898db52d3a9d7347c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:28.513438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a729d-ccf1-4023-af2d-05e2f04526d3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:28.513723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a729d-ccf1-4023-af2d-05e2f04526d3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:28.513996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a729d-ccf1-4023-af2d-05e2f04526d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:28.533190 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dcca63b-dcdc-40ba-8467-f91a4b47df1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3020d9222d004eb98da0ad7697b28d42'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.543195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e63a729d-ccf1-4023-af2d-05e2f04526d3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:28.544734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 915/1833] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:28 2022] DELETE /identity/v3/users/3020d9222d004eb98da0ad7697b28d42 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:28.549152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e63a729d-ccf1-4023-af2d-05e2f04526d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:28.549410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081194b-ea32-483f-8a6d-1bd2d18b156f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:28.549778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081194b-ea32-483f-8a6d-1bd2d18b156f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:28.550127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081194b-ea32-483f-8a6d-1bd2d18b156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:28.585053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3081194b-ea32-483f-8a6d-1bd2d18b156f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:28.586537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3081194b-ea32-483f-8a6d-1bd2d18b156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:28.648131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:28.669205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 919/1834] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:28.670788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a729d-ccf1-4023-af2d-05e2f04526d3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:28.683461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e63a729d-ccf1-4023-af2d-05e2f04526d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:28.701944 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a729d-ccf1-4023-af2d-05e2f04526d3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:28.702147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 916/1835] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:28.703025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081194b-ea32-483f-8a6d-1bd2d18b156f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:28.710550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3081194b-ea32-483f-8a6d-1bd2d18b156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:28.717386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:28.718284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:28.718571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:28.718954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] PATH_INFO: `/v3/projects/4cf4bab4f8254217becc75bf939033ef` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:28.720184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf4bab4f8254217becc75bf939033ef)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:28.722573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:28.762842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:28.800063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081194b-ea32-483f-8a6d-1bd2d18b156f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:28.830409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf4bab4f8254217becc75bf939033ef', 'request_id': 'req-feb5bd46-d03b-4046-a187-33da17a6536a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.846005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf4bab4f8254217becc75bf939033ef', 'request_id': 'req-feb5bd46-d03b-4046-a187-33da17a6536a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.861637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf4bab4f8254217becc75bf939033ef', 'request_id': 'req-feb5bd46-d03b-4046-a187-33da17a6536a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.879792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39cb6e-d877-4e88-a55a-324af57bc688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:28.880502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39cb6e-d877-4e88-a55a-324af57bc688 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:28.880849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39cb6e-d877-4e88-a55a-324af57bc688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:28.881210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39cb6e-d877-4e88-a55a-324af57bc688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:28.881749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] The token cache is being invalidate because project 4cf4bab4f8254217becc75bf939033ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:28.882053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.882762 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:28.884558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 920/1836] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:28 2022] DELETE /identity/v3/projects/4cf4bab4f8254217becc75bf939033ef => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:28.888445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:28.889898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:28.909516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5bd46-d03b-4046-a187-33da17a6536a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:28.915778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885980f-5928-44e9-995b-108701ce8edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:28.916357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885980f-5928-44e9-995b-108701ce8edc service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:28.916609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885980f-5928-44e9-995b-108701ce8edc service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:28.918613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885980f-5928-44e9-995b-108701ce8edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:28.920923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b885980f-5928-44e9-995b-108701ce8edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:28.977968 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39cb6e-d877-4e88-a55a-324af57bc688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:28.979421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39cb6e-d877-4e88-a55a-324af57bc688 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:28.993046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 917/1837] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:28.994425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c43ca-5536-4cb9-8af0-b43701a93470 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:28.994921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c43ca-5536-4cb9-8af0-b43701a93470 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:28.995282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c43ca-5536-4cb9-8af0-b43701a93470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.005931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885980f-5928-44e9-995b-108701ce8edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.008296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885980f-5928-44e9-995b-108701ce8edc service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:29.019766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 921/1838] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:29.023290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dc7c43ca-5536-4cb9-8af0-b43701a93470 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:29.024617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dc7c43ca-5536-4cb9-8af0-b43701a93470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:29.034179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 918/1839] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:29.042218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0e932-2379-4ed8-8b78-bdbb84f27ae9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.042988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0e932-2379-4ed8-8b78-bdbb84f27ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.043336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0e932-2379-4ed8-8b78-bdbb84f27ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.064728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1aa0e932-2379-4ed8-8b78-bdbb84f27ae9 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:29.066423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1aa0e932-2379-4ed8-8b78-bdbb84f27ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:29.080672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 922/1840] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:29.081912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c43ca-5536-4cb9-8af0-b43701a93470 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.092416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c43ca-5536-4cb9-8af0-b43701a93470 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:29.097563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb00f5c-a920-434b-8760-28291851be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:29.098294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb00f5c-a920-434b-8760-28291851be00 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.098714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb00f5c-a920-434b-8760-28291851be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.098980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb00f5c-a920-434b-8760-28291851be00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.099786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb00f5c-a920-434b-8760-28291851be00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:29.100796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb00f5c-a920-434b-8760-28291851be00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.102555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb00f5c-a920-434b-8760-28291851be00 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:29.116971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 919/1841] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:29.121309 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0e932-2379-4ed8-8b78-bdbb84f27ae9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.131508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0e932-2379-4ed8-8b78-bdbb84f27ae9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:29.137053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917413-6d12-4bc6-8bc0-6a38f8037844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:29.137793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917413-6d12-4bc6-8bc0-6a38f8037844 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.138175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917413-6d12-4bc6-8bc0-6a38f8037844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.138561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7917413-6d12-4bc6-8bc0-6a38f8037844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.139351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7917413-6d12-4bc6-8bc0-6a38f8037844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.141671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7917413-6d12-4bc6-8bc0-6a38f8037844 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:29.178977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 923/1842] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:29 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:29.183328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb00f5c-a920-434b-8760-28291851be00 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.196354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb00f5c-a920-434b-8760-28291851be00 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:29.281442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358afdc-1441-4516-847f-26b1df5d1a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:29.282079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358afdc-1441-4516-847f-26b1df5d1a0c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.282364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358afdc-1441-4516-847f-26b1df5d1a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.283233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358afdc-1441-4516-847f-26b1df5d1a0c admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.283369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358afdc-1441-4516-847f-26b1df5d1a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.285274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358afdc-1441-4516-847f-26b1df5d1a0c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:29.318634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 920/1843] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:29 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:29.324663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917413-6d12-4bc6-8bc0-6a38f8037844 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.335971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7917413-6d12-4bc6-8bc0-6a38f8037844 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:29.342392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eca892-b26c-4d72-b8c0-944e00f3d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:29.343050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca892-b26c-4d72-b8c0-944e00f3d47e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.343320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca892-b26c-4d72-b8c0-944e00f3d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.343577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca892-b26c-4d72-b8c0-944e00f3d47e admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.344246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eca892-b26c-4d72-b8c0-944e00f3d47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.346034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eca892-b26c-4d72-b8c0-944e00f3d47e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:29.372188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 924/1844] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:29.376438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358afdc-1441-4516-847f-26b1df5d1a0c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.384360 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:29.389037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358afdc-1441-4516-847f-26b1df5d1a0c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:29.408214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974559b-9698-46df-952e-2abd5e082811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:29.410541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974559b-9698-46df-952e-2abd5e082811 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.411887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974559b-9698-46df-952e-2abd5e082811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.415216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974559b-9698-46df-952e-2abd5e082811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.416218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974559b-9698-46df-952e-2abd5e082811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.418065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974559b-9698-46df-952e-2abd5e082811 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:29.443517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eca892-b26c-4d72-b8c0-944e00f3d47e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.443682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 921/1845] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:29.455201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eca892-b26c-4d72-b8c0-944e00f3d47e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:29.461009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4725bc-0435-4d4b-aa6a-953185e5e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:29.462743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4725bc-0435-4d4b-aa6a-953185e5e0ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.462743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4725bc-0435-4d4b-aa6a-953185e5e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.462743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4725bc-0435-4d4b-aa6a-953185e5e0ca admin admin] PATH_INFO: `/v3/projects/56933713caaa42489f8e4cf6ab1df8b9/users/5cea78b715be4908ad5956a28022a662/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.483777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4725bc-0435-4d4b-aa6a-953185e5e0ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=56933713caaa42489f8e4cf6ab1df8b9, user_id=5cea78b715be4908ad5956a28022a662, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.486918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4725bc-0435-4d4b-aa6a-953185e5e0ca admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:29.531621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bb32d-2d77-4d67-89ed-a28fe3a41cbe None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.531906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bb32d-2d77-4d67-89ed-a28fe3a41cbe None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.532186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bb32d-2d77-4d67-89ed-a28fe3a41cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.535515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 925/1846] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:29 2022] PUT /identity/v3/projects/56933713caaa42489f8e4cf6ab1df8b9/users/5cea78b715be4908ad5956a28022a662/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:29.551370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4725bc-0435-4d4b-aa6a-953185e5e0ca admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.553291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-eb4725bc-0435-4d4b-aa6a-953185e5e0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:29.579378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:29.583338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-658bb32d-2d77-4d67-89ed-a28fe3a41cbe None None] MFA Rules not processed for user `5cea78b715be4908ad5956a28022a662`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:29.591048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-658bb32d-2d77-4d67-89ed-a28fe3a41cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:29.656167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4725bc-0435-4d4b-aa6a-953185e5e0ca admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:29.661461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:29.662100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.662387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.662734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] PATH_INFO: `/v3/projects/f9afe26e46bc474a95cdc473a17a2157` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.663865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9afe26e46bc474a95cdc473a17a2157)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.665806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:29.675627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 922/1847] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:29.677178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bb32d-2d77-4d67-89ed-a28fe3a41cbe None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.697223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bb32d-2d77-4d67-89ed-a28fe3a41cbe None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:29.712666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c4cd0-a1d5-4e08-a857-4c69119c966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:29.713510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c4cd0-a1d5-4e08-a857-4c69119c966d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.713769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c4cd0-a1d5-4e08-a857-4c69119c966d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.714369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c4cd0-a1d5-4e08-a857-4c69119c966d admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.717423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c4cd0-a1d5-4e08-a857-4c69119c966d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.721885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c4cd0-a1d5-4e08-a857-4c69119c966d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:29.750682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9afe26e46bc474a95cdc473a17a2157', 'request_id': 'req-f86efefe-3819-45d3-8caf-2af3fa5d3433'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:29.757108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9afe26e46bc474a95cdc473a17a2157', 'request_id': 'req-f86efefe-3819-45d3-8caf-2af3fa5d3433'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:29.764034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9afe26e46bc474a95cdc473a17a2157', 'request_id': 'req-f86efefe-3819-45d3-8caf-2af3fa5d3433'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:29.771520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 923/1848] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:29 2022] POST /identity/v3/projects => generated 399 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:29.773164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c4cd0-a1d5-4e08-a857-4c69119c966d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.775013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fb7c4cd0-a1d5-4e08-a857-4c69119c966d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:29.805708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] The token cache is being invalidate because project f9afe26e46bc474a95cdc473a17a2157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:29.806294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:29.807910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:29.809837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 926/1849] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:29 2022] DELETE /identity/v3/projects/f9afe26e46bc474a95cdc473a17a2157 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:29.810775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.812235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:29.849243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c4cd0-a1d5-4e08-a857-4c69119c966d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:29.859434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:29.860083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.860381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.860635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] PATH_INFO: `/v3/projects/39a102dce33a47b882c5ccc3732124f7` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.863259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a102dce33a47b882c5ccc3732124f7)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.866491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:29.917647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86efefe-3819-45d3-8caf-2af3fa5d3433 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:29.932799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a102dce33a47b882c5ccc3732124f7', 'request_id': 'req-420ead35-cc98-4fb7-af43-f59633231f35'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:29.943094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a102dce33a47b882c5ccc3732124f7', 'request_id': 'req-420ead35-cc98-4fb7-af43-f59633231f35'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:29.951863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a102dce33a47b882c5ccc3732124f7', 'request_id': 'req-420ead35-cc98-4fb7-af43-f59633231f35'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:29.953699 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:29.972973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:29.974700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] The token cache is being invalidate because project 39a102dce33a47b882c5ccc3732124f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:29.975042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:29.976816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:29.978851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 924/1850] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:29 2022] DELETE /identity/v3/projects/39a102dce33a47b882c5ccc3732124f7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:29.979728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:29.981229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:29.990397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a815cc-1233-4db3-925a-a178567b433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:29.991052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a815cc-1233-4db3-925a-a178567b433f admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:29.991333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a815cc-1233-4db3-925a-a178567b433f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:29.991606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a815cc-1233-4db3-925a-a178567b433f admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:29.993101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a815cc-1233-4db3-925a-a178567b433f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:29.995561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a815cc-1233-4db3-925a-a178567b433f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:30.027360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 927/1851] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:29 2022] POST /identity/v3/users => generated 306 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:30.028506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a815cc-1233-4db3-925a-a178567b433f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:30.035597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-74a815cc-1233-4db3-925a-a178567b433f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:30.070474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a815cc-1233-4db3-925a-a178567b433f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:30.073127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ead35-cc98-4fb7-af43-f59633231f35 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:30.082364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:30.083211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:30.083940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:30.084452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:30.085392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] PATH_INFO: `/v3/users/90bf321c37c6458da626b84384315d2c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:30.086640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90bf321c37c6458da626b84384315d2c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:30.086844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:30.087285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:30.087718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] PATH_INFO: `/v3/users/8cbfc4a302ce4f25906e8466638bc111` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:30.089185 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:30.091701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbfc4a302ce4f25906e8466638bc111)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:30.096527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:30.158455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90bf321c37c6458da626b84384315d2c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.159589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbfc4a302ce4f25906e8466638bc111'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.160322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbfc4a302ce4f25906e8466638bc111'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.168298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbfc4a302ce4f25906e8466638bc111'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.177185 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90bf321c37c6458da626b84384315d2c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.178086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90bf321c37c6458da626b84384315d2c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.181621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbfc4a302ce4f25906e8466638bc111'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.182314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbfc4a302ce4f25906e8466638bc111'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.185857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90bf321c37c6458da626b84384315d2c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.196255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 928/1852] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:30 2022] DELETE /identity/v3/users/8cbfc4a302ce4f25906e8466638bc111 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:30.197153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:30.198547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:30.200598 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90bf321c37c6458da626b84384315d2c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.208901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 925/1853] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:29 2022] DELETE /identity/v3/users/90bf321c37c6458da626b84384315d2c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:30.278157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648b15-0414-4e84-b455-4bf454cf6a92 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:30.348526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1beba-7e98-4b7e-be7f-c8d8b1bdaaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:30.350908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1beba-7e98-4b7e-be7f-c8d8b1bdaaee admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:30.351357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1beba-7e98-4b7e-be7f-c8d8b1bdaaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:30.351739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1beba-7e98-4b7e-be7f-c8d8b1bdaaee admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:30.352776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1beba-7e98-4b7e-be7f-c8d8b1bdaaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:30.358358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1beba-7e98-4b7e-be7f-c8d8b1bdaaee admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:30.358358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:30.377183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 929/1854] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:30.380255 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:30.381834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:30.396672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08906-2dc2-47b1-8ba3-0ce5ebe25027 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:30.413652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b70cb-0038-427a-9d7c-029c66c8a099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:30.414448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b70cb-0038-427a-9d7c-029c66c8a099 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:30.414804 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b70cb-0038-427a-9d7c-029c66c8a099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:30.415146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b70cb-0038-427a-9d7c-029c66c8a099 admin admin] PATH_INFO: `/v3/projects/b72200b75ef64fe0a750d6d034c60721/users/a5937e97cdea40549a85f96b2fa9c797/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:30.431872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b70cb-0038-427a-9d7c-029c66c8a099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72200b75ef64fe0a750d6d034c60721, user_id=a5937e97cdea40549a85f96b2fa9c797, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:30.434628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b70cb-0038-427a-9d7c-029c66c8a099 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:30.449919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 926/1855] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:30 2022] PUT /identity/v3/projects/b72200b75ef64fe0a750d6d034c60721/users/a5937e97cdea40549a85f96b2fa9c797/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:30.453921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1beba-7e98-4b7e-be7f-c8d8b1bdaaee admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:30.464105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1beba-7e98-4b7e-be7f-c8d8b1bdaaee admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:30.521924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac797ea1-784b-48c0-88ed-2abad227245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:30.522538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac797ea1-784b-48c0-88ed-2abad227245b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:30.522821 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac797ea1-784b-48c0-88ed-2abad227245b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:30.523103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac797ea1-784b-48c0-88ed-2abad227245b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:30.523853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac797ea1-784b-48c0-88ed-2abad227245b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:30.525477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac797ea1-784b-48c0-88ed-2abad227245b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:30.538507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 930/1856] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:30.539612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b70cb-0038-427a-9d7c-029c66c8a099 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:30.550239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b70cb-0038-427a-9d7c-029c66c8a099 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:30.556755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618a945-dc78-4ad8-a78e-2892d64f145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:30.557467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618a945-dc78-4ad8-a78e-2892d64f145d admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:30.557741 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618a945-dc78-4ad8-a78e-2892d64f145d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:30.558016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618a945-dc78-4ad8-a78e-2892d64f145d admin admin] PATH_INFO: `/v3/projects/b72200b75ef64fe0a750d6d034c60721/users/a5937e97cdea40549a85f96b2fa9c797/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:30.559932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618a945-dc78-4ad8-a78e-2892d64f145d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72200b75ef64fe0a750d6d034c60721, user_id=a5937e97cdea40549a85f96b2fa9c797, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:30.562800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618a945-dc78-4ad8-a78e-2892d64f145d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:30.580485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 927/1857] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:30 2022] PUT /identity/v3/projects/b72200b75ef64fe0a750d6d034c60721/users/a5937e97cdea40549a85f96b2fa9c797/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:30.594089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ba9d-83e7-44b2-9da0-35c2f718b14c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:30.594515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ba9d-83e7-44b2-9da0-35c2f718b14c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:30.594867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ba9d-83e7-44b2-9da0-35c2f718b14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:30.602778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618a945-dc78-4ad8-a78e-2892d64f145d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:30.604480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0618a945-dc78-4ad8-a78e-2892d64f145d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:30.648563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0456ba9d-83e7-44b2-9da0-35c2f718b14c None None] MFA Rules not processed for user `a5937e97cdea40549a85f96b2fa9c797`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:30.650466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0456ba9d-83e7-44b2-9da0-35c2f718b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:30.672273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=4,keystone:DELETE=11,keystone:SELECT=85 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:30.704135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618a945-dc78-4ad8-a78e-2892d64f145d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:30.708972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:30.710236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:30.710527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:30.710798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] PATH_INFO: `/v3/projects/7601fc459bb34df6be583a7d1061ce70` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:30.711927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7601fc459bb34df6be583a7d1061ce70)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:30.713916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:30.735257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 931/1858] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:30.735257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ba9d-83e7-44b2-9da0-35c2f718b14c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:30.746057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0456ba9d-83e7-44b2-9da0-35c2f718b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:30.775789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ba9d-83e7-44b2-9da0-35c2f718b14c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:30.804168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:30.806459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:30.806459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:30.806459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] PATH_INFO: `/v3/projects/edee9b3420314ad280bafa80ebda5ef0` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:30.838215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edee9b3420314ad280bafa80ebda5ef0)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:30.838215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:30.910423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7601fc459bb34df6be583a7d1061ce70', 'request_id': 'req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.919091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7601fc459bb34df6be583a7d1061ce70', 'request_id': 'req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.927684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7601fc459bb34df6be583a7d1061ce70', 'request_id': 'req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.941552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edee9b3420314ad280bafa80ebda5ef0', 'request_id': 'req-0d746d9b-bbc2-4863-bb18-97c685af9a26'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.956986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] The token cache is being invalidate because project 7601fc459bb34df6be583a7d1061ce70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:30.957289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.957974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.958938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edee9b3420314ad280bafa80ebda5ef0', 'request_id': 'req-0d746d9b-bbc2-4863-bb18-97c685af9a26'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.964705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 928/1859] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:30 2022] DELETE /identity/v3/projects/7601fc459bb34df6be583a7d1061ce70 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:30.964705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:30.964705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:30.978676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edee9b3420314ad280bafa80ebda5ef0', 'request_id': 'req-0d746d9b-bbc2-4863-bb18-97c685af9a26'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:30.997495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:31.006196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] The token cache is being invalidate because project edee9b3420314ad280bafa80ebda5ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:31.007890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:31.009248 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0d746d9b-bbc2-4863-bb18-97c685af9a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:31.011741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 932/1860] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:30 2022] DELETE /identity/v3/projects/edee9b3420314ad280bafa80ebda5ef0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:31.013218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850707dc-c9d4-46b4-aa3d-edf767ae47cb None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.013644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850707dc-c9d4-46b4-aa3d-edf767ae47cb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.014017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850707dc-c9d4-46b4-aa3d-edf767ae47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.043485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-850707dc-c9d4-46b4-aa3d-edf767ae47cb None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:31.045044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-850707dc-c9d4-46b4-aa3d-edf767ae47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:31.055645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95cf8d-ffa6-454c-9bc3-dc35050fc44c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.131119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9a3a4-b704-46e6-87b7-49838f32112f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.132504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a3a4-b704-46e6-87b7-49838f32112f service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.132791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a3a4-b704-46e6-87b7-49838f32112f service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.133088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a3a4-b704-46e6-87b7-49838f32112f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.135326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-69b9a3a4-b704-46e6-87b7-49838f32112f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:31.137643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 933/1861] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:31.139172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc597678-a8c3-4170-93d4-24cc634367f2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.139561 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc597678-a8c3-4170-93d4-24cc634367f2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.139935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc597678-a8c3-4170-93d4-24cc634367f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.183543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-fc597678-a8c3-4170-93d4-24cc634367f2 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:31.184155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fc597678-a8c3-4170-93d4-24cc634367f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:31.196575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 934/1862] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:31.198005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fb249-9809-418c-8043-6a3655edf819 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.198545 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fb249-9809-418c-8043-6a3655edf819 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.198916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fb249-9809-418c-8043-6a3655edf819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.210962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:31.224246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7f5fb249-9809-418c-8043-6a3655edf819 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:31.225774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7f5fb249-9809-418c-8043-6a3655edf819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:31.236648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 935/1863] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:31.242591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba14be-1321-4f0e-833e-45b4b554db7e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.242944 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba14be-1321-4f0e-833e-45b4b554db7e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.243284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba14be-1321-4f0e-833e-45b4b554db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.250850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9a3a4-b704-46e6-87b7-49838f32112f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.252302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9a3a4-b704-46e6-87b7-49838f32112f service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.263991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 929/1864] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:31.265044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9a3a4-b704-46e6-87b7-49838f32112f service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.278504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9a3a4-b704-46e6-87b7-49838f32112f service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.279801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b8ba14be-1321-4f0e-833e-45b4b554db7e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:31.283471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338ffc3-2d6f-4098-a702-9b16922fbfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.284089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338ffc3-2d6f-4098-a702-9b16922fbfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.284627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338ffc3-2d6f-4098-a702-9b16922fbfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.284627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338ffc3-2d6f-4098-a702-9b16922fbfe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.285308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b8ba14be-1321-4f0e-833e-45b4b554db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:31.285474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338ffc3-2d6f-4098-a702-9b16922fbfe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:31.285867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338ffc3-2d6f-4098-a702-9b16922fbfe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.287381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338ffc3-2d6f-4098-a702-9b16922fbfe4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.301710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 936/1865] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:31.304867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 930/1866] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:31.306201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba14be-1321-4f0e-833e-45b4b554db7e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.311745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338ffc3-2d6f-4098-a702-9b16922fbfe4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.328417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338ffc3-2d6f-4098-a702-9b16922fbfe4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.331797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba14be-1321-4f0e-833e-45b4b554db7e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.336746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d68315-8446-4e37-95df-12e2af8f88de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.337601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68315-8446-4e37-95df-12e2af8f88de admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.337957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68315-8446-4e37-95df-12e2af8f88de admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.338299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68315-8446-4e37-95df-12e2af8f88de admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.339005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d68315-8446-4e37-95df-12e2af8f88de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.341256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d68315-8446-4e37-95df-12e2af8f88de admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.345037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e19685-9e91-4c58-8428-8f8f286b2797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.345674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19685-9e91-4c58-8428-8f8f286b2797 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.345955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19685-9e91-4c58-8428-8f8f286b2797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.349059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19685-9e91-4c58-8428-8f8f286b2797 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.349776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e19685-9e91-4c58-8428-8f8f286b2797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:31.350091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e19685-9e91-4c58-8428-8f8f286b2797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.354421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e19685-9e91-4c58-8428-8f8f286b2797 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.381075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 937/1867] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:33:31.386127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e19685-9e91-4c58-8428-8f8f286b2797 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.401153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e19685-9e91-4c58-8428-8f8f286b2797 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.408706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 931/1868] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:31 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:31.409147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680ccbf-078a-4d49-8fcb-3be8506f2e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.409147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ccbf-078a-4d49-8fcb-3be8506f2e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.409147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ccbf-078a-4d49-8fcb-3be8506f2e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.409147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ccbf-078a-4d49-8fcb-3be8506f2e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.409453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680ccbf-078a-4d49-8fcb-3be8506f2e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.411538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680ccbf-078a-4d49-8fcb-3be8506f2e38 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.412766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d68315-8446-4e37-95df-12e2af8f88de admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.414598 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c2d68315-8446-4e37-95df-12e2af8f88de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:31.465369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 938/1869] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:31 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:31.466298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680ccbf-078a-4d49-8fcb-3be8506f2e38 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.548339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d68315-8446-4e37-95df-12e2af8f88de admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.615921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680ccbf-078a-4d49-8fcb-3be8506f2e38 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.622747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d22af-91ad-4f98-92d7-b52c72aaa883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.622919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4179eac-f82d-4939-ac69-14e7d78def08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.623577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4179eac-f82d-4939-ac69-14e7d78def08 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.623920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4179eac-f82d-4939-ac69-14e7d78def08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.624280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4179eac-f82d-4939-ac69-14e7d78def08 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.625070 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d22af-91ad-4f98-92d7-b52c72aaa883 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.625181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4179eac-f82d-4939-ac69-14e7d78def08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.625502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d22af-91ad-4f98-92d7-b52c72aaa883 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.625852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d22af-91ad-4f98-92d7-b52c72aaa883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.627241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4179eac-f82d-4939-ac69-14e7d78def08 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.628430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bc7d22af-91ad-4f98-92d7-b52c72aaa883 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:31.657115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 939/1870] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:31 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:31.657115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4179eac-f82d-4939-ac69-14e7d78def08 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.671818 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4179eac-f82d-4939-ac69-14e7d78def08 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.677439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072472-40a5-4b3c-b87a-034fe4416d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.678142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072472-40a5-4b3c-b87a-034fe4416d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.679212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072472-40a5-4b3c-b87a-034fe4416d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.679515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072472-40a5-4b3c-b87a-034fe4416d62 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.680332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88072472-40a5-4b3c-b87a-034fe4416d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.682684 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88072472-40a5-4b3c-b87a-034fe4416d62 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.716328 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 940/1871] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:31 2022] POST /identity/v3/users => generated 291 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:31.717451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072472-40a5-4b3c-b87a-034fe4416d62 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.722313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-88072472-40a5-4b3c-b87a-034fe4416d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:31.740694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072472-40a5-4b3c-b87a-034fe4416d62 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.748107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.748756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.749069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.749344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] PATH_INFO: `/v3/users/4d8aff4a15834b52b8e7b7027c997333` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.750547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8aff4a15834b52b8e7b7027c997333)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.753022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.760215 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d22af-91ad-4f98-92d7-b52c72aaa883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.762014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d22af-91ad-4f98-92d7-b52c72aaa883 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.771105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:31.776888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 932/1872] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:31.778598 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d22af-91ad-4f98-92d7-b52c72aaa883 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.789002 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:31.796354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d22af-91ad-4f98-92d7-b52c72aaa883 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.807722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8a7e-13a9-4d35-ad22-e3cbf445b49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.808504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8a7e-13a9-4d35-ad22-e3cbf445b49c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.809671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8a7e-13a9-4d35-ad22-e3cbf445b49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.810052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8a7e-13a9-4d35-ad22-e3cbf445b49c admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.811094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd8a7e-13a9-4d35-ad22-e3cbf445b49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.814056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd8a7e-13a9-4d35-ad22-e3cbf445b49c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.831793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 933/1873] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:31.831793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8a7e-13a9-4d35-ad22-e3cbf445b49c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.837743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8aff4a15834b52b8e7b7027c997333'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:31.838441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8aff4a15834b52b8e7b7027c997333'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:31.847206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8a7e-13a9-4d35-ad22-e3cbf445b49c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.851702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8aff4a15834b52b8e7b7027c997333'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:31.854979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b096bb-beee-4810-a196-d5b89dd16848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.858725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b096bb-beee-4810-a196-d5b89dd16848 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.859133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b096bb-beee-4810-a196-d5b89dd16848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.859494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b096bb-beee-4810-a196-d5b89dd16848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.863918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b096bb-beee-4810-a196-d5b89dd16848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.867706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b096bb-beee-4810-a196-d5b89dd16848 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.882798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8aff4a15834b52b8e7b7027c997333'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:31.883268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 934/1874] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:31.883844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8aff4a15834b52b8e7b7027c997333'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:31.884551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b096bb-beee-4810-a196-d5b89dd16848 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.886525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e9b096bb-beee-4810-a196-d5b89dd16848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:31.905092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b096bb-beee-4810-a196-d5b89dd16848 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:31.915680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 941/1875] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:31 2022] DELETE /identity/v3/users/4d8aff4a15834b52b8e7b7027c997333 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:31.923891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:31.927477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:31.933697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906a0cb-a195-42b7-82e2-8335dc6cdcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:31.934608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906a0cb-a195-42b7-82e2-8335dc6cdcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.935006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906a0cb-a195-42b7-82e2-8335dc6cdcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.935512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906a0cb-a195-42b7-82e2-8335dc6cdcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.936282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906a0cb-a195-42b7-82e2-8335dc6cdcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:31.938703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906a0cb-a195-42b7-82e2-8335dc6cdcb2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:31.959512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 935/1876] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:31.961621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd0c48-0615-44ad-b7a7-ea95167597a7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:31.961909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd0c48-0615-44ad-b7a7-ea95167597a7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:31.962182 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd0c48-0615-44ad-b7a7-ea95167597a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:31.986806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7dcd0c48-0615-44ad-b7a7-ea95167597a7 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:31.988417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7dcd0c48-0615-44ad-b7a7-ea95167597a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:32.037513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91652d-c8b6-4eeb-88cb-eb016778e07b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:32.044064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748eba-c88d-4c51-807e-0d96df52c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:32.044685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748eba-c88d-4c51-807e-0d96df52c7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:32.044981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748eba-c88d-4c51-807e-0d96df52c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:32.045266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748eba-c88d-4c51-807e-0d96df52c7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:32.045969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748eba-c88d-4c51-807e-0d96df52c7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:32.061107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748eba-c88d-4c51-807e-0d96df52c7b2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:32.062724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 942/1877] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:32.065257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 936/1878] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:32.067548 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd0c48-0615-44ad-b7a7-ea95167597a7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:32.068773 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748eba-c88d-4c51-807e-0d96df52c7b2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:32.078210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd0c48-0615-44ad-b7a7-ea95167597a7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:32.082702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748eba-c88d-4c51-807e-0d96df52c7b2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:32.083660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7b031-8256-4beb-8652-b26e98b49276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:32.084330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b031-8256-4beb-8652-b26e98b49276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:32.085365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b031-8256-4beb-8652-b26e98b49276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:32.085593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b031-8256-4beb-8652-b26e98b49276 admin admin] PATH_INFO: `/v3/projects/9b2f79b99dbd4418a523e01457955fb6/users/7a087598f9474e2b9e618f523658a4ff/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:32.089783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8390c64-13fc-4d31-baf1-ad065754ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:32.090752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8390c64-13fc-4d31-baf1-ad065754ecaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:32.091039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8390c64-13fc-4d31-baf1-ad065754ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:32.091312 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8390c64-13fc-4d31-baf1-ad065754ecaa admin admin] PATH_INFO: `/v3/projects/ebd6e2a101784f3185ccae3929c9f580/users/4cf3954c717e47f3a2d6d195ea3b8bee/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:32.110290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7b031-8256-4beb-8652-b26e98b49276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2f79b99dbd4418a523e01457955fb6, user_id=7a087598f9474e2b9e618f523658a4ff, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:32.114364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8390c64-13fc-4d31-baf1-ad065754ecaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd6e2a101784f3185ccae3929c9f580, user_id=4cf3954c717e47f3a2d6d195ea3b8bee, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:32.117644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8390c64-13fc-4d31-baf1-ad065754ecaa admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:32.118658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7b031-8256-4beb-8652-b26e98b49276 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:32.142773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 937/1879] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:32 2022] PUT /identity/v3/projects/9b2f79b99dbd4418a523e01457955fb6/users/7a087598f9474e2b9e618f523658a4ff/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:32.155269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe85ec6-cad9-47f9-bd3e-3d2573dc7c35 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:32.155558 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe85ec6-cad9-47f9-bd3e-3d2573dc7c35 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:32.155965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe85ec6-cad9-47f9-bd3e-3d2573dc7c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:32.162478 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 943/1880] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:32 2022] PUT /identity/v3/projects/ebd6e2a101784f3185ccae3929c9f580/users/4cf3954c717e47f3a2d6d195ea3b8bee/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:32.181264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081708ae-e229-4289-a289-0ad559ddc41a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:32.181776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081708ae-e229-4289-a289-0ad559ddc41a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:32.183056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081708ae-e229-4289-a289-0ad559ddc41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:32.232582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-081708ae-e229-4289-a289-0ad559ddc41a None None] MFA Rules not processed for user `4cf3954c717e47f3a2d6d195ea3b8bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:32.234224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-081708ae-e229-4289-a289-0ad559ddc41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:32.234823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-abe85ec6-cad9-47f9-bd3e-3d2573dc7c35 None None] MFA Rules not processed for user `7a087598f9474e2b9e618f523658a4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:32.236647 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-abe85ec6-cad9-47f9-bd3e-3d2573dc7c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:32.298872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:32.324603 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 944/1881] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:32.330719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081708ae-e229-4289-a289-0ad559ddc41a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:32.349515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-081708ae-e229-4289-a289-0ad559ddc41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:32.438369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081708ae-e229-4289-a289-0ad559ddc41a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:32.446116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d9c55-efc7-477c-a64f-71969de80b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:32.446838 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d9c55-efc7-477c-a64f-71969de80b7b service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:32.447010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d9c55-efc7-477c-a64f-71969de80b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:32.447281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d9c55-efc7-477c-a64f-71969de80b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:32.453843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 938/1882] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:32.453843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe85ec6-cad9-47f9-bd3e-3d2573dc7c35 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:32.453843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-abe85ec6-cad9-47f9-bd3e-3d2573dc7c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:32.575728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:32.605547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe85ec6-cad9-47f9-bd3e-3d2573dc7c35 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:32.615652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcf850-c282-4ed8-973a-ed4a74712b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:32.616804 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcf850-c282-4ed8-973a-ed4a74712b55 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:32.617804 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcf850-c282-4ed8-973a-ed4a74712b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:32.617804 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcf850-c282-4ed8-973a-ed4a74712b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:32.625918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d9c55-efc7-477c-a64f-71969de80b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:32.627776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d9c55-efc7-477c-a64f-71969de80b7b service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:32.639026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 945/1883] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:32.640029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d9c55-efc7-477c-a64f-71969de80b7b service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:32.644714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcf850-c282-4ed8-973a-ed4a74712b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:32.647956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcf850-c282-4ed8-973a-ed4a74712b55 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:32.660121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 939/1884] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:32.660491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d9c55-efc7-477c-a64f-71969de80b7b service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:32.675097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e1b3-5ee6-4aac-8688-730609886d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:32.689610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e1b3-5ee6-4aac-8688-730609886d47 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:32.690801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e1b3-5ee6-4aac-8688-730609886d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:32.691210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e1b3-5ee6-4aac-8688-730609886d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:32.692229 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5e1b3-5ee6-4aac-8688-730609886d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:32.695206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5e1b3-5ee6-4aac-8688-730609886d47 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:32.748879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 946/1885] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:32 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:32.750054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcf850-c282-4ed8-973a-ed4a74712b55 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:32.770254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcf850-c282-4ed8-973a-ed4a74712b55 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:32.862794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4103cc-57b5-4511-bee7-2d77477a00a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:32.863834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4103cc-57b5-4511-bee7-2d77477a00a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:32.864258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4103cc-57b5-4511-bee7-2d77477a00a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:32.864919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4103cc-57b5-4511-bee7-2d77477a00a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:32.866516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4103cc-57b5-4511-bee7-2d77477a00a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:32.868305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4103cc-57b5-4511-bee7-2d77477a00a3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:32.899312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 940/1886] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:32 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:32.900490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e1b3-5ee6-4aac-8688-730609886d47 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:32.916820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e1b3-5ee6-4aac-8688-730609886d47 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:32.923306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfd71a-27d8-44c0-bbfb-a454baf93248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:32.925715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfd71a-27d8-44c0-bbfb-a454baf93248 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:32.926261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfd71a-27d8-44c0-bbfb-a454baf93248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:32.926637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfd71a-27d8-44c0-bbfb-a454baf93248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:32.927802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfd71a-27d8-44c0-bbfb-a454baf93248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:32.930583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfd71a-27d8-44c0-bbfb-a454baf93248 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:32.952610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 947/1887] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:32.956712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4103cc-57b5-4511-bee7-2d77477a00a3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:32.980996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4103cc-57b5-4511-bee7-2d77477a00a3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:33.005773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf083ea-7788-4df0-b5bc-90afca600145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:33.006578 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf083ea-7788-4df0-b5bc-90afca600145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:33.006862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf083ea-7788-4df0-b5bc-90afca600145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:33.007142 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf083ea-7788-4df0-b5bc-90afca600145 admin admin] PATH_INFO: `/v3/projects/ef19445a58eb4b828cff0ddf22028f30/users/e93f314cafef4581a262c5ed29d9faf9/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:33.057826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf083ea-7788-4df0-b5bc-90afca600145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef19445a58eb4b828cff0ddf22028f30, user_id=e93f314cafef4581a262c5ed29d9faf9, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:33.060521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf083ea-7788-4df0-b5bc-90afca600145 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:33.093513 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 941/1888] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:32 2022] PUT /identity/v3/projects/ef19445a58eb4b828cff0ddf22028f30/users/e93f314cafef4581a262c5ed29d9faf9/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:33.095065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfd71a-27d8-44c0-bbfb-a454baf93248 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:33.107436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfd71a-27d8-44c0-bbfb-a454baf93248 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:33.247618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b8332-78e1-4f42-b7cc-528b2e46971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:33.250357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b8332-78e1-4f42-b7cc-528b2e46971c admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:33.250736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b8332-78e1-4f42-b7cc-528b2e46971c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:33.251785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b8332-78e1-4f42-b7cc-528b2e46971c admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:33.254104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b8332-78e1-4f42-b7cc-528b2e46971c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:33.256333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b8332-78e1-4f42-b7cc-528b2e46971c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:33.283068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 948/1889] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:33.297881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf083ea-7788-4df0-b5bc-90afca600145 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:33.313712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf083ea-7788-4df0-b5bc-90afca600145 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:33.321807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efac137-c4c6-4e27-ae41-944c673e8c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:33.322758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efac137-c4c6-4e27-ae41-944c673e8c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:33.325023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efac137-c4c6-4e27-ae41-944c673e8c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:33.325481 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efac137-c4c6-4e27-ae41-944c673e8c41 admin admin] PATH_INFO: `/v3/projects/ef19445a58eb4b828cff0ddf22028f30/users/e93f314cafef4581a262c5ed29d9faf9/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:33.327884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efac137-c4c6-4e27-ae41-944c673e8c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef19445a58eb4b828cff0ddf22028f30, user_id=e93f314cafef4581a262c5ed29d9faf9, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:33.339545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efac137-c4c6-4e27-ae41-944c673e8c41 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:33.340811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b8332-78e1-4f42-b7cc-528b2e46971c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:33.342980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-db9b8332-78e1-4f42-b7cc-528b2e46971c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:33.356087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:33.363795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b8332-78e1-4f42-b7cc-528b2e46971c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:33.382298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 942/1890] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:33 2022] PUT /identity/v3/projects/ef19445a58eb4b828cff0ddf22028f30/users/e93f314cafef4581a262c5ed29d9faf9/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:33.396114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932496-37d8-4d24-8a2d-85a325ceedef None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:33.396511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932496-37d8-4d24-8a2d-85a325ceedef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:33.396875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932496-37d8-4d24-8a2d-85a325ceedef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:33.464418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c6932496-37d8-4d24-8a2d-85a325ceedef None None] MFA Rules not processed for user `e93f314cafef4581a262c5ed29d9faf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:33.466884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c6932496-37d8-4d24-8a2d-85a325ceedef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:33.480111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:33.480896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:33.481227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:33.481955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] PATH_INFO: `/v3/projects/5710ab1f531a42e7bcf6c0a7f5531bc0` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:33.482726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5710ab1f531a42e7bcf6c0a7f5531bc0)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:33.484897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:33.559424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5710ab1f531a42e7bcf6c0a7f5531bc0', 'request_id': 'req-bef73d51-ca2a-473f-a38a-869b5d986c4a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:33.568159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 943/1891] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:33.568335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5710ab1f531a42e7bcf6c0a7f5531bc0', 'request_id': 'req-bef73d51-ca2a-473f-a38a-869b5d986c4a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:33.577374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5710ab1f531a42e7bcf6c0a7f5531bc0', 'request_id': 'req-bef73d51-ca2a-473f-a38a-869b5d986c4a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:33.579713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932496-37d8-4d24-8a2d-85a325ceedef None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:33.594737 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] The token cache is being invalidate because project 5710ab1f531a42e7bcf6c0a7f5531bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:33.595035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:33.595776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:33.602369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 949/1892] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:33 2022] DELETE /identity/v3/projects/5710ab1f531a42e7bcf6c0a7f5531bc0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:33.603841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:33.605932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:33.609087 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:33.660065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932496-37d8-4d24-8a2d-85a325ceedef None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:33.690977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef73d51-ca2a-473f-a38a-869b5d986c4a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:33.696250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:33.697040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:33.697425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:33.697770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] PATH_INFO: `/v3/users/314fc93483574816a66ba7632c895ac2` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:33.699738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] RBAC: Authorizing `identity:delete_user(user_id=314fc93483574816a66ba7632c895ac2)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:33.701791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:33.747446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7474ee3-2ebe-4607-8696-290a61d64ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:33.748666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7474ee3-2ebe-4607-8696-290a61d64ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:33.748988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7474ee3-2ebe-4607-8696-290a61d64ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:33.749261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7474ee3-2ebe-4607-8696-290a61d64ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:33.751168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d7474ee3-2ebe-4607-8696-290a61d64ba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:33.751758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:33.765432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314fc93483574816a66ba7632c895ac2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:33.766299 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314fc93483574816a66ba7632c895ac2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:33.777010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314fc93483574816a66ba7632c895ac2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:33.796367 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314fc93483574816a66ba7632c895ac2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:33.797568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314fc93483574816a66ba7632c895ac2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:33.818040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 950/1893] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:33 2022] DELETE /identity/v3/users/314fc93483574816a66ba7632c895ac2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:33.843521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7474ee3-2ebe-4607-8696-290a61d64ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:33.845044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7474ee3-2ebe-4607-8696-290a61d64ba1 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:33.856758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 944/1894] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:34.172014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:34.173961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:34.272909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad410a-d59b-412b-901f-ba57dbb8219b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:34.281442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:34.282079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.282356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.282629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] PATH_INFO: `/v3/projects/8cd3cba156024d9eb786d21ba243518b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.283753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd3cba156024d9eb786d21ba243518b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:34.285687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:34.344662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd3cba156024d9eb786d21ba243518b', 'request_id': 'req-9d219147-8aa9-4755-b677-a2cb1439d9d4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:34.354485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7474ee3-2ebe-4607-8696-290a61d64ba1 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:34.355939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d7474ee3-2ebe-4607-8696-290a61d64ba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:34.364320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd3cba156024d9eb786d21ba243518b', 'request_id': 'req-9d219147-8aa9-4755-b677-a2cb1439d9d4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:34.373573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7474ee3-2ebe-4607-8696-290a61d64ba1 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:34.374954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd3cba156024d9eb786d21ba243518b', 'request_id': 'req-9d219147-8aa9-4755-b677-a2cb1439d9d4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:34.391256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] The token cache is being invalidate because project 8cd3cba156024d9eb786d21ba243518b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:34.391562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:34.393131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9d219147-8aa9-4755-b677-a2cb1439d9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:34.394700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 951/1895] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:34 2022] DELETE /identity/v3/projects/8cd3cba156024d9eb786d21ba243518b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:34.399450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cd530-ea98-40e2-b5ff-615e6c275c22 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.399816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cd530-ea98-40e2-b5ff-615e6c275c22 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.400094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cd530-ea98-40e2-b5ff-615e6c275c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.422427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-083cd530-ea98-40e2-b5ff-615e6c275c22 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:34.423770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-083cd530-ea98-40e2-b5ff-615e6c275c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:34.443697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:34.446051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.446417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.446805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] PATH_INFO: `/v3/users/7a087598f9474e2b9e618f523658a4ff` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.448012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a087598f9474e2b9e618f523658a4ff)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:34.450096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:34.478573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:34.498814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:34.541153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 952/1896] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:34.543135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42d8c2-0a12-425a-b906-ef87cd61b3e8 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.543426 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42d8c2-0a12-425a-b906-ef87cd61b3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.543702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42d8c2-0a12-425a-b906-ef87cd61b3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.544773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a087598f9474e2b9e618f523658a4ff'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:34.572766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a087598f9474e2b9e618f523658a4ff'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:34.573919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a087598f9474e2b9e618f523658a4ff'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:34.583696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cc42d8c2-0a12-425a-b906-ef87cd61b3e8 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:34.584411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cc42d8c2-0a12-425a-b906-ef87cd61b3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:34.590133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a087598f9474e2b9e618f523658a4ff'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:34.595656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 953/1897] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:34.600774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42d8c2-0a12-425a-b906-ef87cd61b3e8 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:34.613627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-291661dd-0b42-4381-838b-e0779c082b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a087598f9474e2b9e618f523658a4ff'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:34.621001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42d8c2-0a12-425a-b906-ef87cd61b3e8 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:34.623526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 945/1898] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:34 2022] DELETE /identity/v3/users/7a087598f9474e2b9e618f523658a4ff => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:34.625108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50bce2-3ba4-4754-8534-d68194137e34 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.625917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50bce2-3ba4-4754-8534-d68194137e34 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.626204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50bce2-3ba4-4754-8534-d68194137e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.647172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6e50bce2-3ba4-4754-8534-d68194137e34 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:34.649247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6e50bce2-3ba4-4754-8534-d68194137e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:34.687499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e26b1-aefd-4603-b52f-a8a7b9d6f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:34.688377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e26b1-aefd-4603-b52f-a8a7b9d6f14e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.690223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e26b1-aefd-4603-b52f-a8a7b9d6f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.690516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e26b1-aefd-4603-b52f-a8a7b9d6f14e admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.691964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e26b1-aefd-4603-b52f-a8a7b9d6f14e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:34.692280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e26b1-aefd-4603-b52f-a8a7b9d6f14e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:34.697173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e26b1-aefd-4603-b52f-a8a7b9d6f14e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:34.716224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 954/1899] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:33:34.718584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e26b1-aefd-4603-b52f-a8a7b9d6f14e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:34.729335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e26b1-aefd-4603-b52f-a8a7b9d6f14e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:34.734015 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed5fc9-1b0b-4564-ad0e-f439b363da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:34.734669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed5fc9-1b0b-4564-ad0e-f439b363da66 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.734954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed5fc9-1b0b-4564-ad0e-f439b363da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.735370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed5fc9-1b0b-4564-ad0e-f439b363da66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.736269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed5fc9-1b0b-4564-ad0e-f439b363da66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:34.738250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed5fc9-1b0b-4564-ad0e-f439b363da66 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:34.747457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 946/1900] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:34.759326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50bce2-3ba4-4754-8534-d68194137e34 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:34.760745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6e50bce2-3ba4-4754-8534-d68194137e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:34.779021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 955/1901] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:34 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:34.784051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed5fc9-1b0b-4564-ad0e-f439b363da66 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:34.861545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50bce2-3ba4-4754-8534-d68194137e34 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:34.868789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed5fc9-1b0b-4564-ad0e-f439b363da66 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:34.875115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb73f3-6756-44cb-b82a-ac5b1095ea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:34.876151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb73f3-6756-44cb-b82a-ac5b1095ea71 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.876151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb73f3-6756-44cb-b82a-ac5b1095ea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.876410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb73f3-6756-44cb-b82a-ac5b1095ea71 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.877076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb73f3-6756-44cb-b82a-ac5b1095ea71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:34.879335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb73f3-6756-44cb-b82a-ac5b1095ea71 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:34.919218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 956/1902] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:34 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:34.924345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb73f3-6756-44cb-b82a-ac5b1095ea71 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:34.927438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056b310-5c44-477f-aef9-3c198693ca9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:34.928108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056b310-5c44-477f-aef9-3c198693ca9b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.928968 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056b310-5c44-477f-aef9-3c198693ca9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.929258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056b310-5c44-477f-aef9-3c198693ca9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.940240 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb73f3-6756-44cb-b82a-ac5b1095ea71 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:34.942435 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056b310-5c44-477f-aef9-3c198693ca9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:34.945569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056b310-5c44-477f-aef9-3c198693ca9b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:34.946704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe40089-78a1-4112-93db-aa07c746347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:34.947953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe40089-78a1-4112-93db-aa07c746347e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.948251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe40089-78a1-4112-93db-aa07c746347e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.948531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe40089-78a1-4112-93db-aa07c746347e admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.949319 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe40089-78a1-4112-93db-aa07c746347e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:34.951054 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe40089-78a1-4112-93db-aa07c746347e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:34.958728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 947/1903] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:34.963834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 957/1904] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:34.968674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056b310-5c44-477f-aef9-3c198693ca9b service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:34.978654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:34.987790 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056b310-5c44-477f-aef9-3c198693ca9b service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:34.994390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3c214-8b98-4e8e-b8fa-11e849b53162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:34.995259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c214-8b98-4e8e-b8fa-11e849b53162 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:34.995621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c214-8b98-4e8e-b8fa-11e849b53162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:34.996154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c214-8b98-4e8e-b8fa-11e849b53162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:34.996879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3c214-8b98-4e8e-b8fa-11e849b53162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:34.998583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3c214-8b98-4e8e-b8fa-11e849b53162 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:35.006811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6bf63-065f-404d-9bb3-24fdb8b4db5a None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.007343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6bf63-065f-404d-9bb3-24fdb8b4db5a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.007783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6bf63-065f-404d-9bb3-24fdb8b4db5a None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.009711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 958/1905] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:33:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 10:33:35.011739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 948/1906] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:35.016433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bfbd9-eac0-4066-93a6-9be27dcb43b1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.016433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bfbd9-eac0-4066-93a6-9be27dcb43b1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.016692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bfbd9-eac0-4066-93a6-9be27dcb43b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.018214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3c214-8b98-4e8e-b8fa-11e849b53162 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:35.035048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3c214-8b98-4e8e-b8fa-11e849b53162 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:35.042605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e434a2-bb60-46af-84b0-c1b31be2fb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:35.043473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e434a2-bb60-46af-84b0-c1b31be2fb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.043834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e434a2-bb60-46af-84b0-c1b31be2fb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.044561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e434a2-bb60-46af-84b0-c1b31be2fb9e admin admin] PATH_INFO: `/v3/projects/9762a604dd47478bb9df0d4f90f6dee2/users/c5161fb85430489c91bc18bde5a38f15/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.053768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d52bfbd9-eac0-4066-93a6-9be27dcb43b1 None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:35.055216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d52bfbd9-eac0-4066-93a6-9be27dcb43b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:35.066908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e434a2-bb60-46af-84b0-c1b31be2fb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9762a604dd47478bb9df0d4f90f6dee2, user_id=c5161fb85430489c91bc18bde5a38f15, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:35.070155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e434a2-bb60-46af-84b0-c1b31be2fb9e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:35.091588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 949/1907] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:35 2022] PUT /identity/v3/projects/9762a604dd47478bb9df0d4f90f6dee2/users/c5161fb85430489c91bc18bde5a38f15/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:35.103231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25073-abaf-43ca-b42c-76a4e1bbbb99 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.103667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25073-abaf-43ca-b42c-76a4e1bbbb99 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.103838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25073-abaf-43ca-b42c-76a4e1bbbb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.123855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:35.140930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-49e25073-abaf-43ca-b42c-76a4e1bbbb99 None None] MFA Rules not processed for user `c5161fb85430489c91bc18bde5a38f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:35.142194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-49e25073-abaf-43ca-b42c-76a4e1bbbb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:35.199632 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 959/1908] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:33:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:35.237016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bfbd9-eac0-4066-93a6-9be27dcb43b1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:35.239214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d52bfbd9-eac0-4066-93a6-9be27dcb43b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:35.241480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 950/1909] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:35.245286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e25073-abaf-43ca-b42c-76a4e1bbbb99 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:35.272088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bfbd9-eac0-4066-93a6-9be27dcb43b1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:35.329388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e25073-abaf-43ca-b42c-76a4e1bbbb99 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:35.337543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4456953-2f88-40f8-9a77-ca0f4bb57f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:35.338603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456953-2f88-40f8-9a77-ca0f4bb57f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.338603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456953-2f88-40f8-9a77-ca0f4bb57f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.338791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456953-2f88-40f8-9a77-ca0f4bb57f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.340356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4456953-2f88-40f8-9a77-ca0f4bb57f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:35.342649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4456953-2f88-40f8-9a77-ca0f4bb57f7e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:35.391471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 951/1910] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:35 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:35.396013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4456953-2f88-40f8-9a77-ca0f4bb57f7e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:35.412032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94106e70-403e-45a5-9187-31dc1d0c05fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:35.412812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94106e70-403e-45a5-9187-31dc1d0c05fa service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.413210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94106e70-403e-45a5-9187-31dc1d0c05fa service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.413489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94106e70-403e-45a5-9187-31dc1d0c05fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.426446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94106e70-403e-45a5-9187-31dc1d0c05fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:35.429114 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94106e70-403e-45a5-9187-31dc1d0c05fa service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:35.448973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 960/1911] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:35.491479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:35.517802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4456953-2f88-40f8-9a77-ca0f4bb57f7e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:35.525616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950aac0-edc9-4e4b-85cf-9b6f87ade6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:35.526960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950aac0-edc9-4e4b-85cf-9b6f87ade6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.527330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950aac0-edc9-4e4b-85cf-9b6f87ade6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.527679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950aac0-edc9-4e4b-85cf-9b6f87ade6e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.528663 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950aac0-edc9-4e4b-85cf-9b6f87ade6e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:35.530520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950aac0-edc9-4e4b-85cf-9b6f87ade6e1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:35.563013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 952/1912] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:35 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:35.567344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94106e70-403e-45a5-9187-31dc1d0c05fa service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:35.581997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94106e70-403e-45a5-9187-31dc1d0c05fa service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:35.588333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2403ff-86b9-4ece-a3e9-cccbbc8c5fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:35.589056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2403ff-86b9-4ece-a3e9-cccbbc8c5fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.589407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2403ff-86b9-4ece-a3e9-cccbbc8c5fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.589751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2403ff-86b9-4ece-a3e9-cccbbc8c5fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.590460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2403ff-86b9-4ece-a3e9-cccbbc8c5fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:35.592118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2403ff-86b9-4ece-a3e9-cccbbc8c5fc7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:35.604999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 961/1913] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:35.608051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950aac0-edc9-4e4b-85cf-9b6f87ade6e1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:35.626007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950aac0-edc9-4e4b-85cf-9b6f87ade6e1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:35.633767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afdb97-9799-4d16-88ea-b398353f4c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:35.635383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afdb97-9799-4d16-88ea-b398353f4c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.635383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afdb97-9799-4d16-88ea-b398353f4c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.635383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afdb97-9799-4d16-88ea-b398353f4c39 admin admin] PATH_INFO: `/v3/projects/b2689bef01dd4cc7968f0b82697ffc76/users/062e693ca4d54894b3bbb8a52df6a17f/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.677653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afdb97-9799-4d16-88ea-b398353f4c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2689bef01dd4cc7968f0b82697ffc76, user_id=062e693ca4d54894b3bbb8a52df6a17f, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:35.681905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afdb97-9799-4d16-88ea-b398353f4c39 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:35.756313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 953/1914] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:35 2022] PUT /identity/v3/projects/b2689bef01dd4cc7968f0b82697ffc76/users/062e693ca4d54894b3bbb8a52df6a17f/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:35.760364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2403ff-86b9-4ece-a3e9-cccbbc8c5fc7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:35.771411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2403ff-86b9-4ece-a3e9-cccbbc8c5fc7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:35.840576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afdb97-9799-4d16-88ea-b398353f4c39 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:35.842459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-05afdb97-9799-4d16-88ea-b398353f4c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:35.934821 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba2475-e42b-4486-87d4-2848c8d9a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:35.935654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2475-e42b-4486-87d4-2848c8d9a36b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.935994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2475-e42b-4486-87d4-2848c8d9a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.936287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2475-e42b-4486-87d4-2848c8d9a36b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.937292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba2475-e42b-4486-87d4-2848c8d9a36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:35.939928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba2475-e42b-4486-87d4-2848c8d9a36b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:35.962018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 962/1915] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:35.967988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba2475-e42b-4486-87d4-2848c8d9a36b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:35.975985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afdb97-9799-4d16-88ea-b398353f4c39 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:35.979487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba2475-e42b-4486-87d4-2848c8d9a36b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:35.983324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:35.983971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.984388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.984805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] PATH_INFO: `/v3/projects/9b2f79b99dbd4418a523e01457955fb6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.984909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc22331-655d-4b46-a501-54c7bee83b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:35.987652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc22331-655d-4b46-a501-54c7bee83b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:35.987953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc22331-655d-4b46-a501-54c7bee83b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:35.988125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2f79b99dbd4418a523e01457955fb6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:35.988406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc22331-655d-4b46-a501-54c7bee83b34 admin admin] PATH_INFO: `/v3/projects/b2689bef01dd4cc7968f0b82697ffc76/users/062e693ca4d54894b3bbb8a52df6a17f/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:35.990686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:35.996161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc22331-655d-4b46-a501-54c7bee83b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2689bef01dd4cc7968f0b82697ffc76, user_id=062e693ca4d54894b3bbb8a52df6a17f, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:36.000300 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc22331-655d-4b46-a501-54c7bee83b34 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:36.025251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 963/1916] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:35 2022] PUT /identity/v3/projects/b2689bef01dd4cc7968f0b82697ffc76/users/062e693ca4d54894b3bbb8a52df6a17f/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:36.032063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae791c-6e69-4827-8059-1e03c1763ade None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:36.033463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae791c-6e69-4827-8059-1e03c1763ade None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:36.034005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae791c-6e69-4827-8059-1e03c1763ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:36.057778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2f79b99dbd4418a523e01457955fb6', 'request_id': 'req-8167701b-92d3-424b-b0ab-b69f12b7c412'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.066366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2f79b99dbd4418a523e01457955fb6', 'request_id': 'req-8167701b-92d3-424b-b0ab-b69f12b7c412'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.086238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2f79b99dbd4418a523e01457955fb6', 'request_id': 'req-8167701b-92d3-424b-b0ab-b69f12b7c412'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.090959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3eae791c-6e69-4827-8059-1e03c1763ade None None] MFA Rules not processed for user `062e693ca4d54894b3bbb8a52df6a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:36.093035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3eae791c-6e69-4827-8059-1e03c1763ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:36.100131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:36.104336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] The token cache is being invalidate because project 9b2f79b99dbd4418a523e01457955fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:36.104900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.105792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.110933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 954/1917] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:35 2022] DELETE /identity/v3/projects/9b2f79b99dbd4418a523e01457955fb6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:36.113301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:36.115148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:36.211434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 964/1918] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:36.221919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:36.224009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae791c-6e69-4827-8059-1e03c1763ade None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:36.228230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3eae791c-6e69-4827-8059-1e03c1763ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:36.285784 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167701b-92d3-424b-b0ab-b69f12b7c412 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:36.290876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:36.292781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:36.293883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:36.295151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] PATH_INFO: `/v3/users/e93f314cafef4581a262c5ed29d9faf9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:36.297405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93f314cafef4581a262c5ed29d9faf9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:36.299389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:36.301710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae791c-6e69-4827-8059-1e03c1763ade None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:36.308807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148dc11-c208-4683-9235-eeda05f6f1b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:36.309570 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148dc11-c208-4683-9235-eeda05f6f1b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:36.310968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148dc11-c208-4683-9235-eeda05f6f1b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:36.310968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148dc11-c208-4683-9235-eeda05f6f1b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:36.321667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148dc11-c208-4683-9235-eeda05f6f1b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:36.323090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148dc11-c208-4683-9235-eeda05f6f1b5 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:36.334275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 965/1919] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:36.373355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93f314cafef4581a262c5ed29d9faf9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.384096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93f314cafef4581a262c5ed29d9faf9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.387054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93f314cafef4581a262c5ed29d9faf9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.400727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148dc11-c208-4683-9235-eeda05f6f1b5 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:36.404821 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a148dc11-c208-4683-9235-eeda05f6f1b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:36.410036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93f314cafef4581a262c5ed29d9faf9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.421620 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148dc11-c208-4683-9235-eeda05f6f1b5 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:36.427195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93f314cafef4581a262c5ed29d9faf9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.445455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 955/1920] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:36 2022] DELETE /identity/v3/users/e93f314cafef4581a262c5ed29d9faf9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:36.445701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3daf8c-1bf9-4c45-b0c2-6cf038e9d2cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:36.445701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3daf8c-1bf9-4c45-b0c2-6cf038e9d2cc service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:36.445701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3daf8c-1bf9-4c45-b0c2-6cf038e9d2cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:36.445701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3daf8c-1bf9-4c45-b0c2-6cf038e9d2cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:36.452986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1f3daf8c-1bf9-4c45-b0c2-6cf038e9d2cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:36.522788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3daf8c-1bf9-4c45-b0c2-6cf038e9d2cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:36.524406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3daf8c-1bf9-4c45-b0c2-6cf038e9d2cc service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:36.534353 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 966/1921] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:36.661575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:36.663051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:36.759036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2819e-b0c5-42a2-a4cb-297ddcdef104 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:36.774392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:36.780842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3daf8c-1bf9-4c45-b0c2-6cf038e9d2cc service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:36.781189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:36.781189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:36.781353 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1f3daf8c-1bf9-4c45-b0c2-6cf038e9d2cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:36.782384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] PATH_INFO: `/v3/users/5cea78b715be4908ad5956a28022a662` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:36.783968 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cea78b715be4908ad5956a28022a662)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:36.788725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:36.802275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3daf8c-1bf9-4c45-b0c2-6cf038e9d2cc service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:36.818916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:36.820349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:36.820632 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:36.820905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] PATH_INFO: `/v3/projects/ef19445a58eb4b828cff0ddf22028f30` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:36.822921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef19445a58eb4b828cff0ddf22028f30)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:36.825342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:36.887096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cea78b715be4908ad5956a28022a662'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.899537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cea78b715be4908ad5956a28022a662'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.900157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cea78b715be4908ad5956a28022a662'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.905925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:36.911156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cea78b715be4908ad5956a28022a662'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.928102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:36.946067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ce0e2e3f-eac1-4623-80e7-0a36f547fa3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cea78b715be4908ad5956a28022a662'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.951508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef19445a58eb4b828cff0ddf22028f30', 'request_id': 'req-f8038c4a-6722-4ab7-8225-56713312cca6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.962998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 956/1922] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:36 2022] DELETE /identity/v3/users/5cea78b715be4908ad5956a28022a662 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:36.970643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef19445a58eb4b828cff0ddf22028f30', 'request_id': 'req-f8038c4a-6722-4ab7-8225-56713312cca6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:36.978844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe28bc-2e16-4150-ae3c-6fee15c76a67 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:36.979367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe28bc-2e16-4150-ae3c-6fee15c76a67 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:36.980030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe28bc-2e16-4150-ae3c-6fee15c76a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:36.981046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef19445a58eb4b828cff0ddf22028f30', 'request_id': 'req-f8038c4a-6722-4ab7-8225-56713312cca6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:37.000045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] The token cache is being invalidate because project ef19445a58eb4b828cff0ddf22028f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:37.000576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:37.001567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f8038c4a-6722-4ab7-8225-56713312cca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:37.003479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 967/1923] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:36 2022] DELETE /identity/v3/projects/ef19445a58eb4b828cff0ddf22028f30 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:37.011578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea5fa-71ab-4933-8247-ed3537b665f4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.012333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea5fa-71ab-4933-8247-ed3537b665f4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.013910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea5fa-71ab-4933-8247-ed3537b665f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.016270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6ffe28bc-2e16-4150-ae3c-6fee15c76a67 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:37.018295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6ffe28bc-2e16-4150-ae3c-6fee15c76a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:37.051731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1e0ea5fa-71ab-4933-8247-ed3537b665f4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:37.053537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1e0ea5fa-71ab-4933-8247-ed3537b665f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:37.096713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 957/1924] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:37.108216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe28bc-2e16-4150-ae3c-6fee15c76a67 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:37.111130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6ffe28bc-2e16-4150-ae3c-6fee15c76a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:37.168064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 968/1925] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:37.176309 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442064df-aded-43d7-99d2-3ce0beee1804 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.176594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442064df-aded-43d7-99d2-3ce0beee1804 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.176868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442064df-aded-43d7-99d2-3ce0beee1804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.196518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe28bc-2e16-4150-ae3c-6fee15c76a67 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:37.201924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bddbe-3230-489f-9293-ca8d22b56d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:37.202884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bddbe-3230-489f-9293-ca8d22b56d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.203167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bddbe-3230-489f-9293-ca8d22b56d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.203407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-442064df-aded-43d7-99d2-3ce0beee1804 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:37.203509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bddbe-3230-489f-9293-ca8d22b56d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.205184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-442064df-aded-43d7-99d2-3ce0beee1804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:37.214915 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bddbe-3230-489f-9293-ca8d22b56d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:37.216712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bddbe-3230-489f-9293-ca8d22b56d2f service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:37.216934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 969/1926] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:37.221217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442064df-aded-43d7-99d2-3ce0beee1804 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:37.240052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 958/1927] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:37.249526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442064df-aded-43d7-99d2-3ce0beee1804 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:37.256138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc93e0-57ac-4f04-ba91-255de979323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:37.257433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc93e0-57ac-4f04-ba91-255de979323a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.257845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc93e0-57ac-4f04-ba91-255de979323a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.258118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc93e0-57ac-4f04-ba91-255de979323a admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.258788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc93e0-57ac-4f04-ba91-255de979323a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:37.259144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc93e0-57ac-4f04-ba91-255de979323a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:37.261512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc93e0-57ac-4f04-ba91-255de979323a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:37.276708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 970/1928] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:37.280892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bddbe-3230-489f-9293-ca8d22b56d2f service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:37.291109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bddbe-3230-489f-9293-ca8d22b56d2f service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:37.296033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fd685-8c97-4d88-86bc-2a8e24ad3412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:37.296647 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fd685-8c97-4d88-86bc-2a8e24ad3412 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.296931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fd685-8c97-4d88-86bc-2a8e24ad3412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.297237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fd685-8c97-4d88-86bc-2a8e24ad3412 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.297886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fd685-8c97-4d88-86bc-2a8e24ad3412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:37.299797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fd685-8c97-4d88-86bc-2a8e24ad3412 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:37.334613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 959/1929] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:37 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:37.335880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc93e0-57ac-4f04-ba91-255de979323a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:37.346398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc93e0-57ac-4f04-ba91-255de979323a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:37.413993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ecdcc-ec1a-4c31-a602-cd67414c888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:37.414610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ecdcc-ec1a-4c31-a602-cd67414c888e admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.414891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ecdcc-ec1a-4c31-a602-cd67414c888e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.415166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ecdcc-ec1a-4c31-a602-cd67414c888e admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.415803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ecdcc-ec1a-4c31-a602-cd67414c888e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:37.417830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ecdcc-ec1a-4c31-a602-cd67414c888e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:37.441183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 971/1930] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:37 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:37.445840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fd685-8c97-4d88-86bc-2a8e24ad3412 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:37.457840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fd685-8c97-4d88-86bc-2a8e24ad3412 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:37.463254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1ffbb-7261-4ea0-81a8-a76fbb48c3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:37.463880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1ffbb-7261-4ea0-81a8-a76fbb48c3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.464194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1ffbb-7261-4ea0-81a8-a76fbb48c3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.464467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1ffbb-7261-4ea0-81a8-a76fbb48c3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.465153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1ffbb-7261-4ea0-81a8-a76fbb48c3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:37.466757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1ffbb-7261-4ea0-81a8-a76fbb48c3f0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:37.478437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 960/1931] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:37.481742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ecdcc-ec1a-4c31-a602-cd67414c888e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:37.491865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ecdcc-ec1a-4c31-a602-cd67414c888e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:37.496820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b7906-c1ed-4d02-aca2-f10a835f9baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:37.497567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7906-c1ed-4d02-aca2-f10a835f9baf admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.497857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7906-c1ed-4d02-aca2-f10a835f9baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.498147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7906-c1ed-4d02-aca2-f10a835f9baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.498787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7906-c1ed-4d02-aca2-f10a835f9baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:37.500395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7906-c1ed-4d02-aca2-f10a835f9baf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:37.511917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 972/1932] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:37.516113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1ffbb-7261-4ea0-81a8-a76fbb48c3f0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:37.527263 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1ffbb-7261-4ea0-81a8-a76fbb48c3f0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:37.532074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2383d00-60c7-47d2-a190-eb800678b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:37.532732 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2383d00-60c7-47d2-a190-eb800678b1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.533348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2383d00-60c7-47d2-a190-eb800678b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.533348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2383d00-60c7-47d2-a190-eb800678b1f3 admin admin] PATH_INFO: `/v3/projects/a86757c7abbf40afb0a76988e1d39043/users/a12548f6679f4f859db4b94061030279/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.548892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2383d00-60c7-47d2-a190-eb800678b1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86757c7abbf40afb0a76988e1d39043, user_id=a12548f6679f4f859db4b94061030279, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:37.551753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2383d00-60c7-47d2-a190-eb800678b1f3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:37.565948 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 961/1933] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:37 2022] PUT /identity/v3/projects/a86757c7abbf40afb0a76988e1d39043/users/a12548f6679f4f859db4b94061030279/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:37.578175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47448f5a-3ed7-410f-89b8-419e3e3bf3b4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.578521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47448f5a-3ed7-410f-89b8-419e3e3bf3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.578742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47448f5a-3ed7-410f-89b8-419e3e3bf3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.608244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-47448f5a-3ed7-410f-89b8-419e3e3bf3b4 None None] MFA Rules not processed for user `a12548f6679f4f859db4b94061030279`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:37.609569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-47448f5a-3ed7-410f-89b8-419e3e3bf3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:37.626614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:37.693619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 973/1934] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:37.708014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2383d00-60c7-47d2-a190-eb800678b1f3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:37.710466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d2383d00-60c7-47d2-a190-eb800678b1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:37.781479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:37.820312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2383d00-60c7-47d2-a190-eb800678b1f3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:37.824866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf8bc9-fc51-475b-a5cb-4fd7de06838f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:37.826051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf8bc9-fc51-475b-a5cb-4fd7de06838f service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.826336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf8bc9-fc51-475b-a5cb-4fd7de06838f service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.827284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf8bc9-fc51-475b-a5cb-4fd7de06838f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.838411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf8bc9-fc51-475b-a5cb-4fd7de06838f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:37.839862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf8bc9-fc51-475b-a5cb-4fd7de06838f service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:37.859792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 962/1935] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:37.870104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47448f5a-3ed7-410f-89b8-419e3e3bf3b4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:37.911780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf8bc9-fc51-475b-a5cb-4fd7de06838f service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:37.914004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-edaf8bc9-fc51-475b-a5cb-4fd7de06838f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:37.956873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47448f5a-3ed7-410f-89b8-419e3e3bf3b4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:37.961897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:37.962533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:37.962813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:37.963086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] PATH_INFO: `/v3/users/a12548f6679f4f859db4b94061030279` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:37.964235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12548f6679f4f859db4b94061030279)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:37.966464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:38.023218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf8bc9-fc51-475b-a5cb-4fd7de06838f service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:38.035464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:38.036458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:38.036747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:38.037082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] PATH_INFO: `/v3/projects/56933713caaa42489f8e4cf6ab1df8b9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:38.039443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56933713caaa42489f8e4cf6ab1df8b9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:38.041592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:38.051882 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12548f6679f4f859db4b94061030279'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.052762 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12548f6679f4f859db4b94061030279'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.063945 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12548f6679f4f859db4b94061030279'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.085905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12548f6679f4f859db4b94061030279'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.086716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5a64b223-bc2d-4b0b-b4d3-e22cfb370eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12548f6679f4f859db4b94061030279'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.121180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 974/1936] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:37 2022] DELETE /identity/v3/users/a12548f6679f4f859db4b94061030279 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:38.124141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4a39f-15cb-46f6-a1d0-098902bcefb6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:38.124141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4a39f-15cb-46f6-a1d0-098902bcefb6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:38.124141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4a39f-15cb-46f6-a1d0-098902bcefb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:38.149109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56933713caaa42489f8e4cf6ab1df8b9', 'request_id': 'req-0e9395bb-5ff7-48a5-b549-c84da2598183'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.156680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4cf4a39f-15cb-46f6-a1d0-098902bcefb6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:38.158115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4cf4a39f-15cb-46f6-a1d0-098902bcefb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:38.158810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56933713caaa42489f8e4cf6ab1df8b9', 'request_id': 'req-0e9395bb-5ff7-48a5-b549-c84da2598183'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.166517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56933713caaa42489f8e4cf6ab1df8b9', 'request_id': 'req-0e9395bb-5ff7-48a5-b549-c84da2598183'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.188747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] The token cache is being invalidate because project 56933713caaa42489f8e4cf6ab1df8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:38.189085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.189918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.193144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 963/1937] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:37 2022] DELETE /identity/v3/projects/56933713caaa42489f8e4cf6ab1df8b9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:38.197843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:38.201314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:38.226386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:38.320616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 975/1938] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:38.341537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4a39f-15cb-46f6-a1d0-098902bcefb6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:38.343217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4cf4a39f-15cb-46f6-a1d0-098902bcefb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:38.345530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:38.358640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9395bb-5ff7-48a5-b549-c84da2598183 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:38.387302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:38.389372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:38.389372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:38.389372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] PATH_INFO: `/v3/users/a5937e97cdea40549a85f96b2fa9c797` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:38.392330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5937e97cdea40549a85f96b2fa9c797)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:38.396229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:38.467882 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4a39f-15cb-46f6-a1d0-098902bcefb6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:38.476725 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee936473-3fa2-4504-a597-6e11f3cdb962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:38.477524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936473-3fa2-4504-a597-6e11f3cdb962 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:38.477809 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936473-3fa2-4504-a597-6e11f3cdb962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:38.478406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee936473-3fa2-4504-a597-6e11f3cdb962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:38.498050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee936473-3fa2-4504-a597-6e11f3cdb962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:38.500252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee936473-3fa2-4504-a597-6e11f3cdb962 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:38.514082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5937e97cdea40549a85f96b2fa9c797'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.526348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 976/1939] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:38.526805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5937e97cdea40549a85f96b2fa9c797'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.527752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5937e97cdea40549a85f96b2fa9c797'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.544382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5937e97cdea40549a85f96b2fa9c797'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.579327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-645aedd3-cf90-4e81-9a2f-8c3b796db924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5937e97cdea40549a85f96b2fa9c797'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:38.587931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 964/1940] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:38 2022] DELETE /identity/v3/users/a5937e97cdea40549a85f96b2fa9c797 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:39.032547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee936473-3fa2-4504-a597-6e11f3cdb962 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.048206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee936473-3fa2-4504-a597-6e11f3cdb962 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:39.122917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:39.123652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.124014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.125062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] PATH_INFO: `/v3/projects/b72200b75ef64fe0a750d6d034c60721` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.125824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72200b75ef64fe0a750d6d034c60721)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:39.128858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:39.182771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72200b75ef64fe0a750d6d034c60721', 'request_id': 'req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:39.189419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72200b75ef64fe0a750d6d034c60721', 'request_id': 'req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:39.195909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72200b75ef64fe0a750d6d034c60721', 'request_id': 'req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:39.214540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] The token cache is being invalidate because project b72200b75ef64fe0a750d6d034c60721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:39.214814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:39.215473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:39.217496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 977/1941] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:39 2022] DELETE /identity/v3/projects/b72200b75ef64fe0a750d6d034c60721 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:39.222279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffc26a-c882-4fe1-91ef-78a5353d3189 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.222421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffc26a-c882-4fe1-91ef-78a5353d3189 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.222709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffc26a-c882-4fe1-91ef-78a5353d3189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.262503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bdffc26a-c882-4fe1-91ef-78a5353d3189 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:39.263781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bdffc26a-c882-4fe1-91ef-78a5353d3189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:39.330532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.336599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:39.357534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 965/1942] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:39.370505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee063a6-8f80-4903-b594-af430676044c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.370505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee063a6-8f80-4903-b594-af430676044c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.370505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee063a6-8f80-4903-b594-af430676044c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.375532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86467d21-2ef0-4b76-9ca3-e5f5baea34b6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:39.381266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:39.382226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.382608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.382983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] PATH_INFO: `/v3/projects/a86757c7abbf40afb0a76988e1d39043` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.384658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86757c7abbf40afb0a76988e1d39043)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:39.387337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:39.392800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:39.394257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6ee063a6-8f80-4903-b594-af430676044c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:39.395551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6ee063a6-8f80-4903-b594-af430676044c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:39.420109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 966/1943] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:39.424010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee063a6-8f80-4903-b594-af430676044c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.435231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee063a6-8f80-4903-b594-af430676044c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:39.443536 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5db1c-e869-4e50-a20a-752d1051cc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:39.445192 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5db1c-e869-4e50-a20a-752d1051cc1d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.445664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5db1c-e869-4e50-a20a-752d1051cc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.446016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5db1c-e869-4e50-a20a-752d1051cc1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.446673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5db1c-e869-4e50-a20a-752d1051cc1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:39.447031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5db1c-e869-4e50-a20a-752d1051cc1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:39.448837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5db1c-e869-4e50-a20a-752d1051cc1d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:39.465806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 967/1944] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:39.466688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5db1c-e869-4e50-a20a-752d1051cc1d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.473747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86757c7abbf40afb0a76988e1d39043', 'request_id': 'req-c4e5056d-e22a-4102-9b7e-c10e352d6c32'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:39.483326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5db1c-e869-4e50-a20a-752d1051cc1d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:39.484704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86757c7abbf40afb0a76988e1d39043', 'request_id': 'req-c4e5056d-e22a-4102-9b7e-c10e352d6c32'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:39.494201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86757c7abbf40afb0a76988e1d39043', 'request_id': 'req-c4e5056d-e22a-4102-9b7e-c10e352d6c32'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:39.516874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] The token cache is being invalidate because project a86757c7abbf40afb0a76988e1d39043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:39.517207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:39.517883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4e5056d-e22a-4102-9b7e-c10e352d6c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:39.519401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 978/1945] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:39 2022] DELETE /identity/v3/projects/a86757c7abbf40afb0a76988e1d39043 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:39.524267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0955f-e513-42c5-9a43-c478d2ea85bd None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.524552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0955f-e513-42c5-9a43-c478d2ea85bd None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.524825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0955f-e513-42c5-9a43-c478d2ea85bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.559874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cce0955f-e513-42c5-9a43-c478d2ea85bd None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:39.561115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cce0955f-e513-42c5-9a43-c478d2ea85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:39.564285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:39.588020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a371be8-6972-4d24-9805-aa2a177007b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:39.588816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a371be8-6972-4d24-9805-aa2a177007b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.589562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a371be8-6972-4d24-9805-aa2a177007b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.589988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a371be8-6972-4d24-9805-aa2a177007b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.591082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a371be8-6972-4d24-9805-aa2a177007b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:39.593415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a371be8-6972-4d24-9805-aa2a177007b5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:39.637683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 968/1946] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:39 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:39.641094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 979/1947] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:39.643605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516469fc-f773-44f6-b408-b2623bfeb988 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.643918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516469fc-f773-44f6-b408-b2623bfeb988 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.644274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516469fc-f773-44f6-b408-b2623bfeb988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.645361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0955f-e513-42c5-9a43-c478d2ea85bd None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.646812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cce0955f-e513-42c5-9a43-c478d2ea85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:39.659392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0955f-e513-42c5-9a43-c478d2ea85bd None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:39.670590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-516469fc-f773-44f6-b408-b2623bfeb988 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:39.671793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-516469fc-f773-44f6-b408-b2623bfeb988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:39.737913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2535e-1cdd-49fa-a5bc-a967e9c5c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:39.738537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2535e-1cdd-49fa-a5bc-a967e9c5c0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.738822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2535e-1cdd-49fa-a5bc-a967e9c5c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.739096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2535e-1cdd-49fa-a5bc-a967e9c5c0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.739775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2535e-1cdd-49fa-a5bc-a967e9c5c0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:39.742983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2535e-1cdd-49fa-a5bc-a967e9c5c0c1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:39.749147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 969/1948] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:39.753827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516469fc-f773-44f6-b408-b2623bfeb988 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.767315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516469fc-f773-44f6-b408-b2623bfeb988 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:39.773495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 980/1949] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:39 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:39.775311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2535e-1cdd-49fa-a5bc-a967e9c5c0c1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.778077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d7ac4-c8b1-40a8-8caf-26f390ccef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:39.779347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d7ac4-c8b1-40a8-8caf-26f390ccef4a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.779775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d7ac4-c8b1-40a8-8caf-26f390ccef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.780205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d7ac4-c8b1-40a8-8caf-26f390ccef4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.781024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d7ac4-c8b1-40a8-8caf-26f390ccef4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:39.781528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d7ac4-c8b1-40a8-8caf-26f390ccef4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:39.783366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d7ac4-c8b1-40a8-8caf-26f390ccef4a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:39.788921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2535e-1cdd-49fa-a5bc-a967e9c5c0c1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:39.796937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854adac-f6d3-41e2-8fe3-7b6311085370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:39.797761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854adac-f6d3-41e2-8fe3-7b6311085370 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.798044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854adac-f6d3-41e2-8fe3-7b6311085370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.798319 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854adac-f6d3-41e2-8fe3-7b6311085370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.799098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854adac-f6d3-41e2-8fe3-7b6311085370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:39.803904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854adac-f6d3-41e2-8fe3-7b6311085370 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:39.804334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 970/1950] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:33:39.805902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d7ac4-c8b1-40a8-8caf-26f390ccef4a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.817134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 981/1951] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:39.824374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d7ac4-c8b1-40a8-8caf-26f390ccef4a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:39.830122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854adac-f6d3-41e2-8fe3-7b6311085370 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.843533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6dfda-a6fc-45cb-a9e4-a009a727b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:39.844181 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6dfda-a6fc-45cb-a9e4-a009a727b27c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.844181 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6dfda-a6fc-45cb-a9e4-a009a727b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.844451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6dfda-a6fc-45cb-a9e4-a009a727b27c admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.845146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6dfda-a6fc-45cb-a9e4-a009a727b27c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:39.849474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6dfda-a6fc-45cb-a9e4-a009a727b27c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:39.850108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854adac-f6d3-41e2-8fe3-7b6311085370 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:39.857336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb39c-101e-4f0b-b467-12e1a0285103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:39.858153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb39c-101e-4f0b-b467-12e1a0285103 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.858659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb39c-101e-4f0b-b467-12e1a0285103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.859108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cb39c-101e-4f0b-b467-12e1a0285103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.859898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cb39c-101e-4f0b-b467-12e1a0285103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:39.861879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cb39c-101e-4f0b-b467-12e1a0285103 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:39.868541 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:39.879075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 982/1952] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:39.886953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb39c-101e-4f0b-b467-12e1a0285103 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.900401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cb39c-101e-4f0b-b467-12e1a0285103 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:39.906341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e640a3e-856c-440f-8459-22ee6a75b09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:39.907222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e640a3e-856c-440f-8459-22ee6a75b09d admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.907507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e640a3e-856c-440f-8459-22ee6a75b09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.907783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e640a3e-856c-440f-8459-22ee6a75b09d admin admin] PATH_INFO: `/v3/projects/0af2ebdc4e5c48a2a0edb13a7bc37308/users/a9b9cab8eca44282a8b70ddd7bdb643b/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:39.916993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 971/1953] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:39 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:39.921055 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6dfda-a6fc-45cb-a9e4-a009a727b27c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:39.930617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e640a3e-856c-440f-8459-22ee6a75b09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af2ebdc4e5c48a2a0edb13a7bc37308, user_id=a9b9cab8eca44282a8b70ddd7bdb643b, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:39.934298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e640a3e-856c-440f-8459-22ee6a75b09d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:39.957385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 983/1954] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:39 2022] PUT /identity/v3/projects/0af2ebdc4e5c48a2a0edb13a7bc37308/users/a9b9cab8eca44282a8b70ddd7bdb643b/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:39.967538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ca6e4-1755-4f4e-8f5b-6aba4590c7b3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:39.967826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ca6e4-1755-4f4e-8f5b-6aba4590c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:39.970847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ca6e4-1755-4f4e-8f5b-6aba4590c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.003478 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-054ca6e4-1755-4f4e-8f5b-6aba4590c7b3 None None] MFA Rules not processed for user `a9b9cab8eca44282a8b70ddd7bdb643b`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:40.004799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-054ca6e4-1755-4f4e-8f5b-6aba4590c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:40.014534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6dfda-a6fc-45cb-a9e4-a009a727b27c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:40.075216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:40.087736 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6d9c-e8f0-4e28-96f0-35dc85be10f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:40.088590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6d9c-e8f0-4e28-96f0-35dc85be10f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.088698 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 984/1955] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:40.089129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6d9c-e8f0-4e28-96f0-35dc85be10f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.089730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a6d9c-e8f0-4e28-96f0-35dc85be10f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.090740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a6d9c-e8f0-4e28-96f0-35dc85be10f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:40.093206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a6d9c-e8f0-4e28-96f0-35dc85be10f1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:40.099759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ca6e4-1755-4f4e-8f5b-6aba4590c7b3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:40.101975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-054ca6e4-1755-4f4e-8f5b-6aba4590c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:40.126515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 972/1956] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:39 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:40.127583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6d9c-e8f0-4e28-96f0-35dc85be10f1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:40.139317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a6d9c-e8f0-4e28-96f0-35dc85be10f1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:40.144753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b191-8824-4794-9951-0b7ba6606301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:40.145389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b191-8824-4794-9951-0b7ba6606301 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.145668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b191-8824-4794-9951-0b7ba6606301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.145937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b191-8824-4794-9951-0b7ba6606301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.146909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89b191-8824-4794-9951-0b7ba6606301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:40.149350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89b191-8824-4794-9951-0b7ba6606301 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:40.165884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 973/1957] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:40.167148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b191-8824-4794-9951-0b7ba6606301 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:40.177954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ca6e4-1755-4f4e-8f5b-6aba4590c7b3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:40.178722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b191-8824-4794-9951-0b7ba6606301 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:40.181683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2975b-1812-412f-b243-a1723ce9c3e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:40.182293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2975b-1812-412f-b243-a1723ce9c3e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.182571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2975b-1812-412f-b243-a1723ce9c3e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.182841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2975b-1812-412f-b243-a1723ce9c3e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.184067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b411f-8c20-454d-b6f4-4738694febb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:40.184670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b411f-8c20-454d-b6f4-4738694febb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.184965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b411f-8c20-454d-b6f4-4738694febb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.185373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b411f-8c20-454d-b6f4-4738694febb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.186017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b411f-8c20-454d-b6f4-4738694febb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:40.187591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b411f-8c20-454d-b6f4-4738694febb5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:40.193364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2975b-1812-412f-b243-a1723ce9c3e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:40.195521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2975b-1812-412f-b243-a1723ce9c3e2 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:40.199231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 974/1958] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:40.203936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b411f-8c20-454d-b6f4-4738694febb5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:40.206099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 985/1959] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:40.216334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b411f-8c20-454d-b6f4-4738694febb5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:40.221218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71776e-969f-439c-86ae-07141c481d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:40.221873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71776e-969f-439c-86ae-07141c481d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.222153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71776e-969f-439c-86ae-07141c481d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.222426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71776e-969f-439c-86ae-07141c481d76 admin admin] PATH_INFO: `/v3/projects/b4df1cd31b0d4789b60fd20d85b3b092/users/e7c95a1b58494cbca62e4ac05f4bcd07/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.242335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71776e-969f-439c-86ae-07141c481d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4df1cd31b0d4789b60fd20d85b3b092, user_id=e7c95a1b58494cbca62e4ac05f4bcd07, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:40.245583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71776e-969f-439c-86ae-07141c481d76 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:40.263538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 975/1960] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:40 2022] PUT /identity/v3/projects/b4df1cd31b0d4789b60fd20d85b3b092/users/e7c95a1b58494cbca62e4ac05f4bcd07/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:40.282666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35edc-5f88-4aa5-8cb0-18d9f27e78ac None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.282666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35edc-5f88-4aa5-8cb0-18d9f27e78ac None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.282666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35edc-5f88-4aa5-8cb0-18d9f27e78ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.321116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-62e35edc-5f88-4aa5-8cb0-18d9f27e78ac None None] MFA Rules not processed for user `e7c95a1b58494cbca62e4ac05f4bcd07`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:40.322355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-62e35edc-5f88-4aa5-8cb0-18d9f27e78ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:40.426225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:40.437339 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 986/1961] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:40.447384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71776e-969f-439c-86ae-07141c481d76 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:40.449588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d71776e-969f-439c-86ae-07141c481d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:40.452403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35edc-5f88-4aa5-8cb0-18d9f27e78ac None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:40.456568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-62e35edc-5f88-4aa5-8cb0-18d9f27e78ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:40.560272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71776e-969f-439c-86ae-07141c481d76 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:40.560702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35edc-5f88-4aa5-8cb0-18d9f27e78ac None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:40.566386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:40.566844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f363912-06ee-455a-8ea3-0943b6652f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:40.567130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.567373 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363912-06ee-455a-8ea3-0943b6652f90 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.567682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.567778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363912-06ee-455a-8ea3-0943b6652f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.568084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f363912-06ee-455a-8ea3-0943b6652f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.568200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] PATH_INFO: `/v3/users/c5161fb85430489c91bc18bde5a38f15` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.570282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5161fb85430489c91bc18bde5a38f15)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:40.572312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:40.586118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f363912-06ee-455a-8ea3-0943b6652f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:40.588165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f363912-06ee-455a-8ea3-0943b6652f90 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:40.630242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 987/1962] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:40.637669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f363912-06ee-455a-8ea3-0943b6652f90 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:40.665708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f363912-06ee-455a-8ea3-0943b6652f90 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:40.665708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:40.665708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.665708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.666261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] PATH_INFO: `/v3/users/e7c95a1b58494cbca62e4ac05f4bcd07` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.666261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c95a1b58494cbca62e4ac05f4bcd07)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:40.666261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:40.696447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5161fb85430489c91bc18bde5a38f15'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:40.707448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5161fb85430489c91bc18bde5a38f15'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:40.708586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5161fb85430489c91bc18bde5a38f15'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:40.722479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5161fb85430489c91bc18bde5a38f15'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:40.746487 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f83cdc5-937a-4f3b-aeea-345824a30f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5161fb85430489c91bc18bde5a38f15'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:40.755994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 976/1963] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:40 2022] DELETE /identity/v3/users/c5161fb85430489c91bc18bde5a38f15 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:40.756181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c95a1b58494cbca62e4ac05f4bcd07'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:40.759979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c95a1b58494cbca62e4ac05f4bcd07'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:40.760744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d56828-e8db-4566-888d-a55ad6467c00 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.761068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d56828-e8db-4566-888d-a55ad6467c00 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.761352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d56828-e8db-4566-888d-a55ad6467c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.770092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c95a1b58494cbca62e4ac05f4bcd07'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:40.782426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-63d56828-e8db-4566-888d-a55ad6467c00 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:40.783668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-63d56828-e8db-4566-888d-a55ad6467c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:40.784812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c95a1b58494cbca62e4ac05f4bcd07'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:40.785567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-771f69ad-3c3a-4113-bc25-6e839352664d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c95a1b58494cbca62e4ac05f4bcd07'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:40.794599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:40.811685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 988/1964] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:40 2022] DELETE /identity/v3/users/e7c95a1b58494cbca62e4ac05f4bcd07 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:40.816040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa096e-f0a9-44e2-a133-d732be494963 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:40.816418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa096e-f0a9-44e2-a133-d732be494963 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:40.816746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa096e-f0a9-44e2-a133-d732be494963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:40.852497 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6bfa096e-f0a9-44e2-a133-d732be494963 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:40.854640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6bfa096e-f0a9-44e2-a133-d732be494963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:40.881387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 977/1965] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:40.892746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d56828-e8db-4566-888d-a55ad6467c00 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:40.894591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-63d56828-e8db-4566-888d-a55ad6467c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:40.939971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 989/1966] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:40.954892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa096e-f0a9-44e2-a133-d732be494963 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:40.956304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6bfa096e-f0a9-44e2-a133-d732be494963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:40.974334 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:41.003385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d56828-e8db-4566-888d-a55ad6467c00 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:41.031507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa096e-f0a9-44e2-a133-d732be494963 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:41.035878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90733bb0-d4e2-40f3-9397-0f9bef6f0945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:41.036568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90733bb0-d4e2-40f3-9397-0f9bef6f0945 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:41.036913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90733bb0-d4e2-40f3-9397-0f9bef6f0945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:41.037284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90733bb0-d4e2-40f3-9397-0f9bef6f0945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:41.054434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90733bb0-d4e2-40f3-9397-0f9bef6f0945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:41.056329 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90733bb0-d4e2-40f3-9397-0f9bef6f0945 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:41.081069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 990/1967] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:41.084893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c456cd-aa2c-4a07-aab8-f090d1a2d954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:41.085555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c456cd-aa2c-4a07-aab8-f090d1a2d954 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:41.085852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c456cd-aa2c-4a07-aab8-f090d1a2d954 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:41.086115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c456cd-aa2c-4a07-aab8-f090d1a2d954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:41.098572 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c456cd-aa2c-4a07-aab8-f090d1a2d954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:41.100017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c456cd-aa2c-4a07-aab8-f090d1a2d954 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:41.112578 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 978/1968] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:41.404014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90733bb0-d4e2-40f3-9397-0f9bef6f0945 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:41.405996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-90733bb0-d4e2-40f3-9397-0f9bef6f0945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:41.425601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90733bb0-d4e2-40f3-9397-0f9bef6f0945 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:41.437410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c456cd-aa2c-4a07-aab8-f090d1a2d954 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:41.439143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-13c456cd-aa2c-4a07-aab8-f090d1a2d954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:41.454834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:41.455489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:41.456395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:41.456669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] PATH_INFO: `/v3/projects/b4df1cd31b0d4789b60fd20d85b3b092` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:41.457877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4df1cd31b0d4789b60fd20d85b3b092)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:41.458876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c456cd-aa2c-4a07-aab8-f090d1a2d954 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:41.460576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:41.466213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:41.467704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:41.468320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:41.468599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] PATH_INFO: `/v3/projects/9762a604dd47478bb9df0d4f90f6dee2` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:41.469836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9762a604dd47478bb9df0d4f90f6dee2)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:41.471817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:41.532884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4df1cd31b0d4789b60fd20d85b3b092', 'request_id': 'req-f03a64ef-58cd-49c7-b257-bd313e537c09'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.541790 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9762a604dd47478bb9df0d4f90f6dee2', 'request_id': 'req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.558118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9762a604dd47478bb9df0d4f90f6dee2', 'request_id': 'req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.560144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4df1cd31b0d4789b60fd20d85b3b092', 'request_id': 'req-f03a64ef-58cd-49c7-b257-bd313e537c09'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.570714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9762a604dd47478bb9df0d4f90f6dee2', 'request_id': 'req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.573461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4df1cd31b0d4789b60fd20d85b3b092', 'request_id': 'req-f03a64ef-58cd-49c7-b257-bd313e537c09'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.587917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:41.597307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] The token cache is being invalidate because project 9762a604dd47478bb9df0d4f90f6dee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:41.598180 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.600103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.601060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] The token cache is being invalidate because project b4df1cd31b0d4789b60fd20d85b3b092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:41.601405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.602522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f03a64ef-58cd-49c7-b257-bd313e537c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.604381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 979/1969] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:41 2022] DELETE /identity/v3/projects/9762a604dd47478bb9df0d4f90f6dee2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:41.608098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 991/1970] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:41 2022] DELETE /identity/v3/projects/b4df1cd31b0d4789b60fd20d85b3b092 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:41.610248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:41.612072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:41.613729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5520-8fc8-4e01-a6ea-658666d86f4d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:41.615193 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5520-8fc8-4e01-a6ea-658666d86f4d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:41.615572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5520-8fc8-4e01-a6ea-658666d86f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:41.664244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-074d5520-8fc8-4e01-a6ea-658666d86f4d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:41.665502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-074d5520-8fc8-4e01-a6ea-658666d86f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:41.741913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f5b2d-192f-4cd3-97ba-e5357e0d2c16 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:41.790311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 992/1971] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:41.800125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6808360-6011-409f-a600-83aa14e85cb1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:41.800547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6808360-6011-409f-a600-83aa14e85cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:41.800830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6808360-6011-409f-a600-83aa14e85cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:41.812458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:41.813132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:41.813412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:41.813684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] PATH_INFO: `/v3/users/062e693ca4d54894b3bbb8a52df6a17f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:41.814853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062e693ca4d54894b3bbb8a52df6a17f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:41.816826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:41.824984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e6808360-6011-409f-a600-83aa14e85cb1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:41.826412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e6808360-6011-409f-a600-83aa14e85cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:41.843471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 993/1972] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:41.851713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6808360-6011-409f-a600-83aa14e85cb1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:41.864341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6808360-6011-409f-a600-83aa14e85cb1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:41.870072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9eee1-d740-4a31-8bd4-1aa15b78f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:41.870791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9eee1-d740-4a31-8bd4-1aa15b78f139 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:41.871521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9eee1-d740-4a31-8bd4-1aa15b78f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:41.871521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9eee1-d740-4a31-8bd4-1aa15b78f139 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:41.872303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9eee1-d740-4a31-8bd4-1aa15b78f139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:41.872691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9eee1-d740-4a31-8bd4-1aa15b78f139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:41.874796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9eee1-d740-4a31-8bd4-1aa15b78f139 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:41.892366 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 994/1973] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:41.896909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9eee1-d740-4a31-8bd4-1aa15b78f139 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:41.903892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062e693ca4d54894b3bbb8a52df6a17f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.910143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9eee1-d740-4a31-8bd4-1aa15b78f139 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:41.912225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062e693ca4d54894b3bbb8a52df6a17f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.913042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062e693ca4d54894b3bbb8a52df6a17f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.915269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c058-7c2c-49d7-91e5-0cfe599e9820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:41.915877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c058-7c2c-49d7-91e5-0cfe599e9820 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:41.916146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c058-7c2c-49d7-91e5-0cfe599e9820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:41.916420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c058-7c2c-49d7-91e5-0cfe599e9820 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:41.917094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c058-7c2c-49d7-91e5-0cfe599e9820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:41.918976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c058-7c2c-49d7-91e5-0cfe599e9820 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:41.921330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062e693ca4d54894b3bbb8a52df6a17f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.936349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062e693ca4d54894b3bbb8a52df6a17f'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:41.942466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:41.953362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 980/1974] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:41 2022] DELETE /identity/v3/users/062e693ca4d54894b3bbb8a52df6a17f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:41.983449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 995/1975] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:41 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:41.984212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:41.986299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:42.028451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:42.077615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e487f1-8fdf-43ca-ae0d-a68327f37aa0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:42.147208 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a2202-4862-4899-a133-34dee7029ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:42.148697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a2202-4862-4899-a133-34dee7029ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:42.149181 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a2202-4862-4899-a133-34dee7029ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:42.149655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a2202-4862-4899-a133-34dee7029ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:42.150459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a2202-4862-4899-a133-34dee7029ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:42.152781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a2202-4862-4899-a133-34dee7029ba6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:42.176081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 981/1976] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:41 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:42.180276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c058-7c2c-49d7-91e5-0cfe599e9820 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:42.190414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c058-7c2c-49d7-91e5-0cfe599e9820 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:42.195823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56f3b0-8843-4cda-88b4-57870ddd9b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:42.196423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56f3b0-8843-4cda-88b4-57870ddd9b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:42.196702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56f3b0-8843-4cda-88b4-57870ddd9b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:42.196997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56f3b0-8843-4cda-88b4-57870ddd9b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:42.197637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56f3b0-8843-4cda-88b4-57870ddd9b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:42.199224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56f3b0-8843-4cda-88b4-57870ddd9b4c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:42.209107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 996/1977] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:42.213811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a2202-4862-4899-a133-34dee7029ba6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:42.225954 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a2202-4862-4899-a133-34dee7029ba6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:42.230872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5d0a9-0666-49fe-b547-deddd290704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:42.231461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5d0a9-0666-49fe-b547-deddd290704e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:42.231733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5d0a9-0666-49fe-b547-deddd290704e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:42.231995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5d0a9-0666-49fe-b547-deddd290704e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:42.232695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5d0a9-0666-49fe-b547-deddd290704e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:42.234297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5d0a9-0666-49fe-b547-deddd290704e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:42.246517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 982/1978] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:42.250320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56f3b0-8843-4cda-88b4-57870ddd9b4c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:42.267617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56f3b0-8843-4cda-88b4-57870ddd9b4c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:42.272540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa74d01-73e7-4a3e-996a-78e1de2999d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:42.273233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa74d01-73e7-4a3e-996a-78e1de2999d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:42.273543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa74d01-73e7-4a3e-996a-78e1de2999d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:42.273954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa74d01-73e7-4a3e-996a-78e1de2999d3 admin admin] PATH_INFO: `/v3/projects/35b629161b1f408986316ac4274f1b02/users/a6b457ccc32f48749f1739008cfad194/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:42.294546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa74d01-73e7-4a3e-996a-78e1de2999d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b629161b1f408986316ac4274f1b02, user_id=a6b457ccc32f48749f1739008cfad194, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:42.297602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa74d01-73e7-4a3e-996a-78e1de2999d3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:42.315104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 997/1979] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:42 2022] PUT /identity/v3/projects/35b629161b1f408986316ac4274f1b02/users/a6b457ccc32f48749f1739008cfad194/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:42.326780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677c4b-3b7f-4dd0-a6a7-6bbf5403d23c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:42.327451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677c4b-3b7f-4dd0-a6a7-6bbf5403d23c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:42.328924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677c4b-3b7f-4dd0-a6a7-6bbf5403d23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:42.360868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b8677c4b-3b7f-4dd0-a6a7-6bbf5403d23c None None] MFA Rules not processed for user `a6b457ccc32f48749f1739008cfad194`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:42.365000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b8677c4b-3b7f-4dd0-a6a7-6bbf5403d23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:42.454558 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 983/1980] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:42.466771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa74d01-73e7-4a3e-996a-78e1de2999d3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:42.469115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bfa74d01-73e7-4a3e-996a-78e1de2999d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:42.541858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa74d01-73e7-4a3e-996a-78e1de2999d3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:42.546336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e23e49-dc60-48eb-8ac9-f842193417ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:42.547024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e23e49-dc60-48eb-8ac9-f842193417ad service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:42.547192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e23e49-dc60-48eb-8ac9-f842193417ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:42.547493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e23e49-dc60-48eb-8ac9-f842193417ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:42.557377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e23e49-dc60-48eb-8ac9-f842193417ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:42.572504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e23e49-dc60-48eb-8ac9-f842193417ad service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:42.608559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 998/1981] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:43.020920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677c4b-3b7f-4dd0-a6a7-6bbf5403d23c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:43.023192 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b8677c4b-3b7f-4dd0-a6a7-6bbf5403d23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:43.137662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:43.204656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677c4b-3b7f-4dd0-a6a7-6bbf5403d23c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:43.238074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:43.238074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:43.238074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:43.238074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] PATH_INFO: `/v3/projects/b2689bef01dd4cc7968f0b82697ffc76` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:43.238561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2689bef01dd4cc7968f0b82697ffc76)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:43.238561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:43.326228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2689bef01dd4cc7968f0b82697ffc76', 'request_id': 'req-70290279-7d75-4490-bd52-e5b35109084a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:43.337444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2689bef01dd4cc7968f0b82697ffc76', 'request_id': 'req-70290279-7d75-4490-bd52-e5b35109084a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:43.343417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2689bef01dd4cc7968f0b82697ffc76', 'request_id': 'req-70290279-7d75-4490-bd52-e5b35109084a'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:43.360052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] The token cache is being invalidate because project b2689bef01dd4cc7968f0b82697ffc76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:43.360052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:43.360052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-70290279-7d75-4490-bd52-e5b35109084a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:43.361496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 984/1982] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:43 2022] DELETE /identity/v3/projects/b2689bef01dd4cc7968f0b82697ffc76 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:43.367110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019ac1-7528-4cdb-a8e6-4327f531811c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:43.367394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019ac1-7528-4cdb-a8e6-4327f531811c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:43.367668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019ac1-7528-4cdb-a8e6-4327f531811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:43.390001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f5019ac1-7528-4cdb-a8e6-4327f531811c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:43.391370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f5019ac1-7528-4cdb-a8e6-4327f531811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:43.474132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 999/1983] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:43.482485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee2255-54b5-40e5-949d-bc9e2537f72d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:43.482813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee2255-54b5-40e5-949d-bc9e2537f72d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:43.483092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee2255-54b5-40e5-949d-bc9e2537f72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:43.504790 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-62ee2255-54b5-40e5-949d-bc9e2537f72d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:43.506173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-62ee2255-54b5-40e5-949d-bc9e2537f72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:43.517855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 985/1984] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:43.523033 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5019ac1-7528-4cdb-a8e6-4327f531811c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:43.533327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5019ac1-7528-4cdb-a8e6-4327f531811c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:43.539120 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bdf81-5573-46f5-89ad-5ff63eb15ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:43.539618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bdf81-5573-46f5-89ad-5ff63eb15ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:43.539998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bdf81-5573-46f5-89ad-5ff63eb15ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:43.540160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bdf81-5573-46f5-89ad-5ff63eb15ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:43.540807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bdf81-5573-46f5-89ad-5ff63eb15ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:43.541142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bdf81-5573-46f5-89ad-5ff63eb15ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:43.542790 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bdf81-5573-46f5-89ad-5ff63eb15ec9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:43.557366 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1000/1985] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:43.563947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee2255-54b5-40e5-949d-bc9e2537f72d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:43.576577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee2255-54b5-40e5-949d-bc9e2537f72d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:43.581533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8400cb-77be-4703-8333-af942bd9a62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:43.582245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8400cb-77be-4703-8333-af942bd9a62c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:43.582620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8400cb-77be-4703-8333-af942bd9a62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:43.582969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8400cb-77be-4703-8333-af942bd9a62c admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:43.583687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8400cb-77be-4703-8333-af942bd9a62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:43.585875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8400cb-77be-4703-8333-af942bd9a62c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:43.618181 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 986/1986] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:43 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:43.619195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bdf81-5573-46f5-89ad-5ff63eb15ec9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:43.629508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bdf81-5573-46f5-89ad-5ff63eb15ec9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:43.683365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:43.706059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae949c-e0a0-4ff4-a561-684da0133d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:43.706692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae949c-e0a0-4ff4-a561-684da0133d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:43.706977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae949c-e0a0-4ff4-a561-684da0133d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:43.707253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae949c-e0a0-4ff4-a561-684da0133d5d admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:43.708425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae949c-e0a0-4ff4-a561-684da0133d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:43.711413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae949c-e0a0-4ff4-a561-684da0133d5d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:43.742388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1001/1987] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:43 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:43.750911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8400cb-77be-4703-8333-af942bd9a62c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:43.760247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8400cb-77be-4703-8333-af942bd9a62c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:43.769546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d8877-3ea9-4f5c-afa9-622267893fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:43.770472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d8877-3ea9-4f5c-afa9-622267893fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:43.770843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d8877-3ea9-4f5c-afa9-622267893fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:43.771190 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d8877-3ea9-4f5c-afa9-622267893fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:43.771910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d8877-3ea9-4f5c-afa9-622267893fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:43.774669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d8877-3ea9-4f5c-afa9-622267893fd7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:43.790057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 987/1988] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:43.795911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae949c-e0a0-4ff4-a561-684da0133d5d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:43.810511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae949c-e0a0-4ff4-a561-684da0133d5d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:43.825290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f19a90-4fd3-4090-89be-21aa46330cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:43.827473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f19a90-4fd3-4090-89be-21aa46330cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:43.827787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f19a90-4fd3-4090-89be-21aa46330cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:43.828068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f19a90-4fd3-4090-89be-21aa46330cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:43.828728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f19a90-4fd3-4090-89be-21aa46330cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:43.835897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f19a90-4fd3-4090-89be-21aa46330cc8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:43.857249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1002/1989] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:43.862292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d8877-3ea9-4f5c-afa9-622267893fd7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:43.879785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d8877-3ea9-4f5c-afa9-622267893fd7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:43.885359 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffda63e-3b2c-4f54-a2a9-f5d467211d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:43.886119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffda63e-3b2c-4f54-a2a9-f5d467211d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:43.886502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffda63e-3b2c-4f54-a2a9-f5d467211d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:43.886789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffda63e-3b2c-4f54-a2a9-f5d467211d2c admin admin] PATH_INFO: `/v3/projects/3ea7d591d18f446aa46494735343d18c/users/38898981752144d4a1d89bf11d0bf683/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:43.903556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffda63e-3b2c-4f54-a2a9-f5d467211d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea7d591d18f446aa46494735343d18c, user_id=38898981752144d4a1d89bf11d0bf683, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:43.906264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffda63e-3b2c-4f54-a2a9-f5d467211d2c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:43.922515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 988/1990] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:43 2022] PUT /identity/v3/projects/3ea7d591d18f446aa46494735343d18c/users/38898981752144d4a1d89bf11d0bf683/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:43.935214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0108c-d9c8-4bf0-9ade-68fcc9dbe13c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:43.935503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0108c-d9c8-4bf0-9ade-68fcc9dbe13c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:43.935772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0108c-d9c8-4bf0-9ade-68fcc9dbe13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:43.963919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-eeb0108c-d9c8-4bf0-9ade-68fcc9dbe13c None None] MFA Rules not processed for user `38898981752144d4a1d89bf11d0bf683`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:43.965160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-eeb0108c-d9c8-4bf0-9ade-68fcc9dbe13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:44.051125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1003/1991] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:44.056196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffda63e-3b2c-4f54-a2a9-f5d467211d2c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:44.146928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffda63e-3b2c-4f54-a2a9-f5d467211d2c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:44.154260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad3d25-d08f-49b1-bdec-90956dbd5ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:44.154881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad3d25-d08f-49b1-bdec-90956dbd5ecd admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:44.155158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad3d25-d08f-49b1-bdec-90956dbd5ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:44.155426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad3d25-d08f-49b1-bdec-90956dbd5ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:44.156107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad3d25-d08f-49b1-bdec-90956dbd5ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:44.158248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad3d25-d08f-49b1-bdec-90956dbd5ecd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:44.176981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:44.213506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 989/1992] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:44 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:44.217908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0108c-d9c8-4bf0-9ade-68fcc9dbe13c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:44.234222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0108c-d9c8-4bf0-9ade-68fcc9dbe13c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:44.335028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64457-2d33-4ba3-9b1b-a2ceab81354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:44.336081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64457-2d33-4ba3-9b1b-a2ceab81354b admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:44.336571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64457-2d33-4ba3-9b1b-a2ceab81354b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:44.337149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64457-2d33-4ba3-9b1b-a2ceab81354b admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:44.338157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff64457-2d33-4ba3-9b1b-a2ceab81354b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:44.340369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff64457-2d33-4ba3-9b1b-a2ceab81354b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:44.391055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1004/1993] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:44 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:44.396596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad3d25-d08f-49b1-bdec-90956dbd5ecd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:44.410654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad3d25-d08f-49b1-bdec-90956dbd5ecd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:44.416515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac535c8-879b-4ea9-8566-0cdc95801533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:44.417513 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac535c8-879b-4ea9-8566-0cdc95801533 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:44.417972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac535c8-879b-4ea9-8566-0cdc95801533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:44.418330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac535c8-879b-4ea9-8566-0cdc95801533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:44.419031 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac535c8-879b-4ea9-8566-0cdc95801533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:44.421150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac535c8-879b-4ea9-8566-0cdc95801533 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:44.434351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 990/1994] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:44.439460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64457-2d33-4ba3-9b1b-a2ceab81354b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:44.455082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64457-2d33-4ba3-9b1b-a2ceab81354b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:44.463003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eea022-7ddd-438d-a48b-0525ad8becca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:44.463624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea022-7ddd-438d-a48b-0525ad8becca admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:44.463960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea022-7ddd-438d-a48b-0525ad8becca admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:44.464219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea022-7ddd-438d-a48b-0525ad8becca admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:44.464929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eea022-7ddd-438d-a48b-0525ad8becca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:44.466619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eea022-7ddd-438d-a48b-0525ad8becca admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:44.477956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1005/1995] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:44.482149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac535c8-879b-4ea9-8566-0cdc95801533 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:44.496264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac535c8-879b-4ea9-8566-0cdc95801533 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:44.504637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d3697-3d99-4c73-b9b0-730c2493aef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:44.505346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d3697-3d99-4c73-b9b0-730c2493aef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:44.505695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d3697-3d99-4c73-b9b0-730c2493aef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:44.506099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d3697-3d99-4c73-b9b0-730c2493aef0 admin admin] PATH_INFO: `/v3/projects/306567f7e09744afbb43b095b83ea38c/users/bcc8d68dee3f44d98ad7915e08bb7a9e/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:44.542822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d3697-3d99-4c73-b9b0-730c2493aef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306567f7e09744afbb43b095b83ea38c, user_id=bcc8d68dee3f44d98ad7915e08bb7a9e, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:44.545837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d3697-3d99-4c73-b9b0-730c2493aef0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:44.585709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 991/1996] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:44 2022] PUT /identity/v3/projects/306567f7e09744afbb43b095b83ea38c/users/bcc8d68dee3f44d98ad7915e08bb7a9e/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:44.597300 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521807-00cf-4f28-97a2-d2ee4dacf6ce None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:44.597511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521807-00cf-4f28-97a2-d2ee4dacf6ce None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:44.597792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521807-00cf-4f28-97a2-d2ee4dacf6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:44.637296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d7521807-00cf-4f28-97a2-d2ee4dacf6ce None None] MFA Rules not processed for user `bcc8d68dee3f44d98ad7915e08bb7a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:44.639462 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d7521807-00cf-4f28-97a2-d2ee4dacf6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:44.679853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:44.717525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1006/1997] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:44.721972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d3697-3d99-4c73-b9b0-730c2493aef0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:44.785445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d3697-3d99-4c73-b9b0-730c2493aef0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:44.790536 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f640a-4d57-4b55-bbcb-2d765057962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:44.791145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f640a-4d57-4b55-bbcb-2d765057962e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:44.791428 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f640a-4d57-4b55-bbcb-2d765057962e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:44.791706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f640a-4d57-4b55-bbcb-2d765057962e admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:44.792338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f640a-4d57-4b55-bbcb-2d765057962e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:44.794255 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f640a-4d57-4b55-bbcb-2d765057962e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:44.821250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 992/1998] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:44 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:44.825512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7521807-00cf-4f28-97a2-d2ee4dacf6ce None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:44.836570 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7521807-00cf-4f28-97a2-d2ee4dacf6ce None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:44.895994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9f453-2ca5-403d-9712-19f8674d27fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:44.896606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9f453-2ca5-403d-9712-19f8674d27fa admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:44.896896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9f453-2ca5-403d-9712-19f8674d27fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:44.897454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9f453-2ca5-403d-9712-19f8674d27fa admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:44.898571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9f453-2ca5-403d-9712-19f8674d27fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:44.900601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9f453-2ca5-403d-9712-19f8674d27fa admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:44.925558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1007/1999] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:44 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:44.929622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f640a-4d57-4b55-bbcb-2d765057962e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:44.967888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f640a-4d57-4b55-bbcb-2d765057962e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:44.979580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9cfbf-ca32-49a3-9947-8e03fa525afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:44.982579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9cfbf-ca32-49a3-9947-8e03fa525afa admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:44.987125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9cfbf-ca32-49a3-9947-8e03fa525afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:44.987639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9cfbf-ca32-49a3-9947-8e03fa525afa admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:44.990356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9cfbf-ca32-49a3-9947-8e03fa525afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:44.993437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9cfbf-ca32-49a3-9947-8e03fa525afa admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:45.017591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 993/2000] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:45.022125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9f453-2ca5-403d-9712-19f8674d27fa admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:45.035537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9f453-2ca5-403d-9712-19f8674d27fa admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:45.041652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85922eb8-f102-46a8-be5c-143472c520f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:45.042548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85922eb8-f102-46a8-be5c-143472c520f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:45.044098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85922eb8-f102-46a8-be5c-143472c520f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:45.044098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85922eb8-f102-46a8-be5c-143472c520f6 admin admin] PATH_INFO: `/v3/projects/3041fcc396d44d418447dfd5556fb7c3/users/97f9a1d6ec514546ae71d943577d8a2c/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:45.062738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85922eb8-f102-46a8-be5c-143472c520f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3041fcc396d44d418447dfd5556fb7c3, user_id=97f9a1d6ec514546ae71d943577d8a2c, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:45.067420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85922eb8-f102-46a8-be5c-143472c520f6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:45.088575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1008/2001] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:45 2022] PUT /identity/v3/projects/3041fcc396d44d418447dfd5556fb7c3/users/97f9a1d6ec514546ae71d943577d8a2c/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:45.093629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9cfbf-ca32-49a3-9947-8e03fa525afa admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:45.107382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9cfbf-ca32-49a3-9947-8e03fa525afa admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:45.177787 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab08024-3195-46d4-8bcb-851d600b5931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:45.179245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab08024-3195-46d4-8bcb-851d600b5931 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:45.179650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab08024-3195-46d4-8bcb-851d600b5931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:45.179970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab08024-3195-46d4-8bcb-851d600b5931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:45.180591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab08024-3195-46d4-8bcb-851d600b5931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:45.182297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab08024-3195-46d4-8bcb-851d600b5931 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:45.197441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 994/2002] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:45.202153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85922eb8-f102-46a8-be5c-143472c520f6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:45.212583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85922eb8-f102-46a8-be5c-143472c520f6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:45.221872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d20271-af4d-403d-b59a-08d28304a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:45.222623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d20271-af4d-403d-b59a-08d28304a806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:45.223023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d20271-af4d-403d-b59a-08d28304a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:45.223301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d20271-af4d-403d-b59a-08d28304a806 admin admin] PATH_INFO: `/v3/projects/3041fcc396d44d418447dfd5556fb7c3/users/97f9a1d6ec514546ae71d943577d8a2c/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:45.226166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d20271-af4d-403d-b59a-08d28304a806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3041fcc396d44d418447dfd5556fb7c3, user_id=97f9a1d6ec514546ae71d943577d8a2c, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:45.228777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d20271-af4d-403d-b59a-08d28304a806 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:45.239463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1009/2003] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:45 2022] PUT /identity/v3/projects/3041fcc396d44d418447dfd5556fb7c3/users/97f9a1d6ec514546ae71d943577d8a2c/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:45.250496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbbca6-6f20-4d0a-8218-10be365b5148 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:45.250789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbbca6-6f20-4d0a-8218-10be365b5148 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:45.251069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbbca6-6f20-4d0a-8218-10be365b5148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:45.280521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0dbbbca6-6f20-4d0a-8218-10be365b5148 None None] MFA Rules not processed for user `97f9a1d6ec514546ae71d943577d8a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:45.281809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0dbbbca6-6f20-4d0a-8218-10be365b5148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:45.295938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:45.353032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 995/2004] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:45.364548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d20271-af4d-403d-b59a-08d28304a806 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:45.366753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-71d20271-af4d-403d-b59a-08d28304a806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:45.431153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d20271-af4d-403d-b59a-08d28304a806 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:45.434757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5990dc3-459d-4047-9a09-18651893a178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:45.435366 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5990dc3-459d-4047-9a09-18651893a178 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:45.435646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5990dc3-459d-4047-9a09-18651893a178 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:45.435917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5990dc3-459d-4047-9a09-18651893a178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:45.445571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5990dc3-459d-4047-9a09-18651893a178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:45.446989 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5990dc3-459d-4047-9a09-18651893a178 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:45.456901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1010/2005] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:45.498507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbbca6-6f20-4d0a-8218-10be365b5148 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:45.499904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0dbbbca6-6f20-4d0a-8218-10be365b5148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:45.511704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbbca6-6f20-4d0a-8218-10be365b5148 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:45.515234 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80ede-ca80-4b2b-8458-7ce492d6697a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:45.515846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80ede-ca80-4b2b-8458-7ce492d6697a service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:45.516130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80ede-ca80-4b2b-8458-7ce492d6697a service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:45.516412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80ede-ca80-4b2b-8458-7ce492d6697a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:45.574358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80ede-ca80-4b2b-8458-7ce492d6697a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:45.575799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80ede-ca80-4b2b-8458-7ce492d6697a service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:45.586482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 996/2006] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:46.050514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5990dc3-459d-4047-9a09-18651893a178 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:46.051917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b5990dc3-459d-4047-9a09-18651893a178 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:46.084573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:46.123462 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5990dc3-459d-4047-9a09-18651893a178 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:46.128044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:46.128675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:46.128969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:46.129263 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] PATH_INFO: `/v3/users/a9b9cab8eca44282a8b70ddd7bdb643b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:46.130392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b9cab8eca44282a8b70ddd7bdb643b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:46.132906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:46.188261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b9cab8eca44282a8b70ddd7bdb643b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:46.188837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b9cab8eca44282a8b70ddd7bdb643b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:46.196649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b9cab8eca44282a8b70ddd7bdb643b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:46.208638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b9cab8eca44282a8b70ddd7bdb643b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:46.209346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b9cab8eca44282a8b70ddd7bdb643b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:46.222130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1011/2007] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:46 2022] DELETE /identity/v3/users/a9b9cab8eca44282a8b70ddd7bdb643b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:46.226762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5215df-2001-4749-8b8a-4c6ff34e38cf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:46.227268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5215df-2001-4749-8b8a-4c6ff34e38cf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:46.227268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5215df-2001-4749-8b8a-4c6ff34e38cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:46.247198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-fa5215df-2001-4749-8b8a-4c6ff34e38cf None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:46.248458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fa5215df-2001-4749-8b8a-4c6ff34e38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:46.311577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 997/2008] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:46.322039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:46.323449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:46.402523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6609ae7-b8f1-44c1-ad24-bd19511ad60d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:46.406419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5354f-9746-426e-9dd5-f27792259bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:46.407024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5354f-9746-426e-9dd5-f27792259bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:46.407544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5354f-9746-426e-9dd5-f27792259bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:46.407544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5354f-9746-426e-9dd5-f27792259bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:46.418385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5354f-9746-426e-9dd5-f27792259bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:46.420013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5354f-9746-426e-9dd5-f27792259bb0 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:46.430839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1012/2009] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:46.712933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5215df-2001-4749-8b8a-4c6ff34e38cf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:46.714420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fa5215df-2001-4749-8b8a-4c6ff34e38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:46.727160 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5215df-2001-4749-8b8a-4c6ff34e38cf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:46.738509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:46.739165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:46.739455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:46.739761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] PATH_INFO: `/v3/projects/0af2ebdc4e5c48a2a0edb13a7bc37308` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:46.740913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af2ebdc4e5c48a2a0edb13a7bc37308)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:46.743514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:46.789873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:46.792825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af2ebdc4e5c48a2a0edb13a7bc37308', 'request_id': 'req-00249267-106e-46a1-819d-a45416258eb9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:46.799394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af2ebdc4e5c48a2a0edb13a7bc37308', 'request_id': 'req-00249267-106e-46a1-819d-a45416258eb9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:46.805105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af2ebdc4e5c48a2a0edb13a7bc37308', 'request_id': 'req-00249267-106e-46a1-819d-a45416258eb9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:46.816845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] The token cache is being invalidate because project 0af2ebdc4e5c48a2a0edb13a7bc37308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:46.817184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:46.817814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-00249267-106e-46a1-819d-a45416258eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:46.819301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 998/2010] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:46 2022] DELETE /identity/v3/projects/0af2ebdc4e5c48a2a0edb13a7bc37308 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:46.824407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8206c-f8ba-435c-8c10-ff9ec614bea2 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:46.824695 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8206c-f8ba-435c-8c10-ff9ec614bea2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:46.824988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8206c-f8ba-435c-8c10-ff9ec614bea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:46.844642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-97b8206c-f8ba-435c-8c10-ff9ec614bea2 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:46.845883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-97b8206c-f8ba-435c-8c10-ff9ec614bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:46.889132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:46.908282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1013/2011] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:46.915928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189df00-2239-42ac-9803-b0a522261b49 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:46.916217 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189df00-2239-42ac-9803-b0a522261b49 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:46.916494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189df00-2239-42ac-9803-b0a522261b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:46.937315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4189df00-2239-42ac-9803-b0a522261b49 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:46.938525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4189df00-2239-42ac-9803-b0a522261b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:46.947178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 999/2012] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:46.951593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8206c-f8ba-435c-8c10-ff9ec614bea2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:46.962925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8206c-f8ba-435c-8c10-ff9ec614bea2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:46.967741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263d4ce-acb3-4570-9deb-5459c3e8771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:46.968468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263d4ce-acb3-4570-9deb-5459c3e8771f admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:46.968749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263d4ce-acb3-4570-9deb-5459c3e8771f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:46.969047 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263d4ce-acb3-4570-9deb-5459c3e8771f admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:46.969700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263d4ce-acb3-4570-9deb-5459c3e8771f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:46.969999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263d4ce-acb3-4570-9deb-5459c3e8771f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:46.971621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263d4ce-acb3-4570-9deb-5459c3e8771f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:46.989151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1014/2013] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:46.993439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189df00-2239-42ac-9803-b0a522261b49 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:47.007202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189df00-2239-42ac-9803-b0a522261b49 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:47.019724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30952-e6f6-42a6-85e5-58e7971f3582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:47.020357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30952-e6f6-42a6-85e5-58e7971f3582 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:47.020643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30952-e6f6-42a6-85e5-58e7971f3582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:47.020919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30952-e6f6-42a6-85e5-58e7971f3582 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:47.021607 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee30952-e6f6-42a6-85e5-58e7971f3582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:47.024079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee30952-e6f6-42a6-85e5-58e7971f3582 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:47.081597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1000/2014] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:46 2022] POST /identity/v3/projects => generated 361 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:47.083431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263d4ce-acb3-4570-9deb-5459c3e8771f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:47.098537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263d4ce-acb3-4570-9deb-5459c3e8771f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:47.219262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1516950-f10b-4328-8def-3e65941383d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:47.222479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516950-f10b-4328-8def-3e65941383d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:47.223089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516950-f10b-4328-8def-3e65941383d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:47.224156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516950-f10b-4328-8def-3e65941383d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:47.227185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1516950-f10b-4328-8def-3e65941383d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:47.230880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1516950-f10b-4328-8def-3e65941383d3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:47.280423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1015/2015] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:47 2022] POST /identity/v3/users => generated 281 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:47.294282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30952-e6f6-42a6-85e5-58e7971f3582 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:47.309922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30952-e6f6-42a6-85e5-58e7971f3582 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:47.318067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1862f-7e50-4d89-b65e-50fe0f6f5f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:47.318819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1862f-7e50-4d89-b65e-50fe0f6f5f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:47.319228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1862f-7e50-4d89-b65e-50fe0f6f5f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:47.320089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1862f-7e50-4d89-b65e-50fe0f6f5f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:47.321100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1862f-7e50-4d89-b65e-50fe0f6f5f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:47.323314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1862f-7e50-4d89-b65e-50fe0f6f5f44 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:47.340144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1001/2016] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:47.341581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1516950-f10b-4328-8def-3e65941383d3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:47.354065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1516950-f10b-4328-8def-3e65941383d3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:47.358940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92edfc-5361-4ea3-87f3-2f5c751f3d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:47.359981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92edfc-5361-4ea3-87f3-2f5c751f3d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:47.360271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92edfc-5361-4ea3-87f3-2f5c751f3d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:47.360667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92edfc-5361-4ea3-87f3-2f5c751f3d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:47.361651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92edfc-5361-4ea3-87f3-2f5c751f3d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:47.363452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92edfc-5361-4ea3-87f3-2f5c751f3d76 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:47.381609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1016/2017] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:47.386356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1862f-7e50-4d89-b65e-50fe0f6f5f44 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:47.396933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1862f-7e50-4d89-b65e-50fe0f6f5f44 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:47.402580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88a7a4-3123-4a8f-8e86-a7950e806236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:47.402747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88a7a4-3123-4a8f-8e86-a7950e806236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:47.402946 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88a7a4-3123-4a8f-8e86-a7950e806236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:47.403218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88a7a4-3123-4a8f-8e86-a7950e806236 admin admin] PATH_INFO: `/v3/projects/013a3d229b5b4784b8e84e0de7d38974/users/575f22188a4c4865bd7fd2ca3898fa50/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:47.422306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88a7a4-3123-4a8f-8e86-a7950e806236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013a3d229b5b4784b8e84e0de7d38974, user_id=575f22188a4c4865bd7fd2ca3898fa50, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:47.426212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88a7a4-3123-4a8f-8e86-a7950e806236 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:47.449924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1002/2018] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:47 2022] PUT /identity/v3/projects/013a3d229b5b4784b8e84e0de7d38974/users/575f22188a4c4865bd7fd2ca3898fa50/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:47.459842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4568-4a5d-40f1-a6ef-3fe003f6cbb3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:47.460225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4568-4a5d-40f1-a6ef-3fe003f6cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:47.460451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c4568-4a5d-40f1-a6ef-3fe003f6cbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:47.492978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-642c4568-4a5d-40f1-a6ef-3fe003f6cbb3 None None] MFA Rules not processed for user `575f22188a4c4865bd7fd2ca3898fa50`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:47.494297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-642c4568-4a5d-40f1-a6ef-3fe003f6cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:47.579305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1017/2019] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:47.623514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88a7a4-3123-4a8f-8e86-a7950e806236 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:47.625718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5e88a7a4-3123-4a8f-8e86-a7950e806236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:47.692200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88a7a4-3123-4a8f-8e86-a7950e806236 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:47.697565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb60ac-069a-441e-b441-c5434cdb7d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:47.698239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb60ac-069a-441e-b441-c5434cdb7d3a service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:47.698516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb60ac-069a-441e-b441-c5434cdb7d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:47.698787 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb60ac-069a-441e-b441-c5434cdb7d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:47.707842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb60ac-069a-441e-b441-c5434cdb7d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:47.709606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb60ac-069a-441e-b441-c5434cdb7d3a service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:47.719833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1003/2020] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:47.736626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4568-4a5d-40f1-a6ef-3fe003f6cbb3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:47.793203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:47.812972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c4568-4a5d-40f1-a6ef-3fe003f6cbb3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:47.817671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:47.818333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:47.818617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:47.818890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] PATH_INFO: `/v3/users/575f22188a4c4865bd7fd2ca3898fa50` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:47.820874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575f22188a4c4865bd7fd2ca3898fa50)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:47.822803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:47.877637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575f22188a4c4865bd7fd2ca3898fa50'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:47.878468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575f22188a4c4865bd7fd2ca3898fa50'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:47.886666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575f22188a4c4865bd7fd2ca3898fa50'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:47.899321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575f22188a4c4865bd7fd2ca3898fa50'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:47.900209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575f22188a4c4865bd7fd2ca3898fa50'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:47.914218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1018/2021] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:47 2022] DELETE /identity/v3/users/575f22188a4c4865bd7fd2ca3898fa50 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:47.918649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699fe94-d932-4ab3-ac74-cf7198a23cc3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:47.918965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699fe94-d932-4ab3-ac74-cf7198a23cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:47.919245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699fe94-d932-4ab3-ac74-cf7198a23cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:47.939063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7699fe94-d932-4ab3-ac74-cf7198a23cc3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:47.940388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7699fe94-d932-4ab3-ac74-cf7198a23cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:48.007963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1004/2022] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:48.018013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:48.019589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:48.079766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e275ef-2307-4d3c-80d1-ecdc64878a75 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:48.083452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c82b01-b9f5-4d0b-9eaf-afe5bfd6848c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:48.084044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82b01-b9f5-4d0b-9eaf-afe5bfd6848c service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:48.084326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82b01-b9f5-4d0b-9eaf-afe5bfd6848c service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:48.084599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82b01-b9f5-4d0b-9eaf-afe5bfd6848c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:48.094290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c82b01-b9f5-4d0b-9eaf-afe5bfd6848c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:48.095707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c82b01-b9f5-4d0b-9eaf-afe5bfd6848c service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:48.105635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1019/2023] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:48.463028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699fe94-d932-4ab3-ac74-cf7198a23cc3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:48.464995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7699fe94-d932-4ab3-ac74-cf7198a23cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:48.491951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699fe94-d932-4ab3-ac74-cf7198a23cc3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:48.499843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:48.500916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:48.501321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:48.501721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] PATH_INFO: `/v3/projects/013a3d229b5b4784b8e84e0de7d38974` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:48.504166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=013a3d229b5b4784b8e84e0de7d38974)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:48.514574 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:48.532106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:48.624170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013a3d229b5b4784b8e84e0de7d38974', 'request_id': 'req-f3465936-4628-42d6-b2af-a4685170d283'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:48.632368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013a3d229b5b4784b8e84e0de7d38974', 'request_id': 'req-f3465936-4628-42d6-b2af-a4685170d283'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:48.641141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013a3d229b5b4784b8e84e0de7d38974', 'request_id': 'req-f3465936-4628-42d6-b2af-a4685170d283'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:48.659334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] The token cache is being invalidate because project 013a3d229b5b4784b8e84e0de7d38974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:48.659641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:48.660319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:48.661994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1005/2024] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:48 2022] DELETE /identity/v3/projects/013a3d229b5b4784b8e84e0de7d38974 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:48.667874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4655d83-80b0-4075-a1ea-388eb69b0ed3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:48.668188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4655d83-80b0-4075-a1ea-388eb69b0ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:48.668721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4655d83-80b0-4075-a1ea-388eb69b0ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:48.683730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:48.686982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:48.707635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a4655d83-80b0-4075-a1ea-388eb69b0ed3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:48.714131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a4655d83-80b0-4075-a1ea-388eb69b0ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:48.793767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3465936-4628-42d6-b2af-a4685170d283 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:48.800846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:48.801946 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:48.802559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:48.803355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] PATH_INFO: `/v3/users/4cf3954c717e47f3a2d6d195ea3b8bee` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:48.805504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf3954c717e47f3a2d6d195ea3b8bee)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:48.807857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:48.847202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1020/2025] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:48.848672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded68dfc-ef33-4310-a451-56d2fb061e65 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:48.848975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded68dfc-ef33-4310-a451-56d2fb061e65 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:48.849467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded68dfc-ef33-4310-a451-56d2fb061e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:48.863500 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:48.878582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ded68dfc-ef33-4310-a451-56d2fb061e65 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:48.880055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ded68dfc-ef33-4310-a451-56d2fb061e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:48.893275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1021/2026] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:48.894453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded68dfc-ef33-4310-a451-56d2fb061e65 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:48.895176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf3954c717e47f3a2d6d195ea3b8bee'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:48.898644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ded68dfc-ef33-4310-a451-56d2fb061e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:48.908691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf3954c717e47f3a2d6d195ea3b8bee'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:48.910531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf3954c717e47f3a2d6d195ea3b8bee'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:48.914533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded68dfc-ef33-4310-a451-56d2fb061e65 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:48.920002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:48.921377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:48.921819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:48.922175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] PATH_INFO: `/v3/users/38898981752144d4a1d89bf11d0bf683` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:48.925475 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=38898981752144d4a1d89bf11d0bf683)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:48.928345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:48.941206 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf3954c717e47f3a2d6d195ea3b8bee'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:48.970424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf3954c717e47f3a2d6d195ea3b8bee'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:48.994483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1006/2027] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:48 2022] DELETE /identity/v3/users/4cf3954c717e47f3a2d6d195ea3b8bee => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:48.995194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:49.002686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38898981752144d4a1d89bf11d0bf683'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:49.003386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38898981752144d4a1d89bf11d0bf683'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:49.003849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:49.022263 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38898981752144d4a1d89bf11d0bf683'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:49.033174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:49.050224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38898981752144d4a1d89bf11d0bf683'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:49.052738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ce7529f8-5d78-4e57-955c-82f4993075ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38898981752144d4a1d89bf11d0bf683'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:49.095877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1022/2028] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:48 2022] DELETE /identity/v3/users/38898981752144d4a1d89bf11d0bf683 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:49.097204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9bacf-fec4-48fa-b773-705b0366dead None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.097500 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9bacf-fec4-48fa-b773-705b0366dead None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.097783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9bacf-fec4-48fa-b773-705b0366dead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.109017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc67e48-7cea-4af2-90de-bacab680d449 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:49.133069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a8c9bacf-fec4-48fa-b773-705b0366dead None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:49.135392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a8c9bacf-fec4-48fa-b773-705b0366dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:49.214764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1023/2029] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:49.216154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df905c-e1f7-4e85-a620-3a954f283cfa None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.216445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df905c-e1f7-4e85-a620-3a954f283cfa None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.216721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df905c-e1f7-4e85-a620-3a954f283cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.230423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e400b-b764-4e47-ab72-ceddf9cba545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:49.231440 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e400b-b764-4e47-ab72-ceddf9cba545 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.231918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e400b-b764-4e47-ab72-ceddf9cba545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.232382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e400b-b764-4e47-ab72-ceddf9cba545 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.233702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e400b-b764-4e47-ab72-ceddf9cba545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:49.235257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e400b-b764-4e47-ab72-ceddf9cba545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:49.237133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e400b-b764-4e47-ab72-ceddf9cba545 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:49.239434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-04df905c-e1f7-4e85-a620-3a954f283cfa None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:49.241354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-04df905c-e1f7-4e85-a620-3a954f283cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:49.255830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1024/2030] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:49.258265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df905c-e1f7-4e85-a620-3a954f283cfa None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:49.259872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-04df905c-e1f7-4e85-a620-3a954f283cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:49.270217 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1007/2031] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:49.277781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e400b-b764-4e47-ab72-ceddf9cba545 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:49.281338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f50e400b-b764-4e47-ab72-ceddf9cba545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:49.345082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df905c-e1f7-4e85-a620-3a954f283cfa None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:49.358768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb553b-2683-49fd-850d-4c9b373b43f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:49.358768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb553b-2683-49fd-850d-4c9b373b43f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.358768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb553b-2683-49fd-850d-4c9b373b43f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.358768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb553b-2683-49fd-850d-4c9b373b43f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.372934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb553b-2683-49fd-850d-4c9b373b43f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:49.374693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb553b-2683-49fd-850d-4c9b373b43f9 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:49.387848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1025/2032] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:49.388770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb553b-2683-49fd-850d-4c9b373b43f9 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:49.390225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cedb553b-2683-49fd-850d-4c9b373b43f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:49.407596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb553b-2683-49fd-850d-4c9b373b43f9 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:49.414377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96e68f-4901-45ae-b4c4-1e1b91a589ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:49.415076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96e68f-4901-45ae-b4c4-1e1b91a589ae admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.415430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96e68f-4901-45ae-b4c4-1e1b91a589ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.415956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96e68f-4901-45ae-b4c4-1e1b91a589ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.416829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96e68f-4901-45ae-b4c4-1e1b91a589ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:49.420927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96e68f-4901-45ae-b4c4-1e1b91a589ae admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:49.424500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e400b-b764-4e47-ab72-ceddf9cba545 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:49.425766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:49.434290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c4906-9657-4b01-a096-8fd8ad27cd20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:49.435462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4906-9657-4b01-a096-8fd8ad27cd20 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.437375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4906-9657-4b01-a096-8fd8ad27cd20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.438084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4906-9657-4b01-a096-8fd8ad27cd20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.455552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4906-9657-4b01-a096-8fd8ad27cd20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:49.457541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4906-9657-4b01-a096-8fd8ad27cd20 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:49.464695 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1026/2033] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:49 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:49.468566 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96e68f-4901-45ae-b4c4-1e1b91a589ae admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:49.474958 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1008/2034] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:49.547957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96e68f-4901-45ae-b4c4-1e1b91a589ae admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:49.553124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59766742-76be-413b-b203-b0259fa74ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:49.554369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59766742-76be-413b-b203-b0259fa74ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.554789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59766742-76be-413b-b203-b0259fa74ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.555076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59766742-76be-413b-b203-b0259fa74ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.555712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59766742-76be-413b-b203-b0259fa74ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:49.557658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59766742-76be-413b-b203-b0259fa74ba1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:49.582205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1027/2035] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:49 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:49.586501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c4906-9657-4b01-a096-8fd8ad27cd20 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:49.597177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c4906-9657-4b01-a096-8fd8ad27cd20 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:49.603915 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bceab22-d0c2-4de8-92ad-52dca1f06f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:49.604698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceab22-d0c2-4de8-92ad-52dca1f06f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.604915 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceab22-d0c2-4de8-92ad-52dca1f06f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.605235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceab22-d0c2-4de8-92ad-52dca1f06f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.606106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bceab22-d0c2-4de8-92ad-52dca1f06f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:49.607995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bceab22-d0c2-4de8-92ad-52dca1f06f4b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:49.623862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1009/2036] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:49.625690 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59766742-76be-413b-b203-b0259fa74ba1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:49.635902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59766742-76be-413b-b203-b0259fa74ba1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:49.640506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f115c2d-ca55-428e-937c-2b288e264bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:49.641149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115c2d-ca55-428e-937c-2b288e264bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.641429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115c2d-ca55-428e-937c-2b288e264bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.641704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115c2d-ca55-428e-937c-2b288e264bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.642341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f115c2d-ca55-428e-937c-2b288e264bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:49.643913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f115c2d-ca55-428e-937c-2b288e264bcb admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:49.657030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1028/2037] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:49.658619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bceab22-d0c2-4de8-92ad-52dca1f06f4b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:49.669771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bceab22-d0c2-4de8-92ad-52dca1f06f4b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:49.674408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82968a66-d297-4ce3-a2c4-10039e4ae9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:49.675054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968a66-d297-4ce3-a2c4-10039e4ae9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.675335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968a66-d297-4ce3-a2c4-10039e4ae9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.675611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968a66-d297-4ce3-a2c4-10039e4ae9ef admin admin] PATH_INFO: `/v3/projects/2285bddb311f455fb973e364c157923f/users/4d23a86c89cd44dbb39dbc7396b98e0f/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.693981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82968a66-d297-4ce3-a2c4-10039e4ae9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2285bddb311f455fb973e364c157923f, user_id=4d23a86c89cd44dbb39dbc7396b98e0f, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:49.697534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82968a66-d297-4ce3-a2c4-10039e4ae9ef admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:49.716991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1010/2038] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:49 2022] PUT /identity/v3/projects/2285bddb311f455fb973e364c157923f/users/4d23a86c89cd44dbb39dbc7396b98e0f/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:49.719343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dc13-3415-4356-9238-49db5e6aaed4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.719343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dc13-3415-4356-9238-49db5e6aaed4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.719589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624dc13-3415-4356-9238-49db5e6aaed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.740063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4624dc13-3415-4356-9238-49db5e6aaed4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:49.741885 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4624dc13-3415-4356-9238-49db5e6aaed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:49.814859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1029/2039] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:49.827108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82968a66-d297-4ce3-a2c4-10039e4ae9ef admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:49.829224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-82968a66-d297-4ce3-a2c4-10039e4ae9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:49.858090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624dc13-3415-4356-9238-49db5e6aaed4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:49.860746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4624dc13-3415-4356-9238-49db5e6aaed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:49.891998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624dc13-3415-4356-9238-49db5e6aaed4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:49.894149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:49.900970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:49.901719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.902153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.902480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] PATH_INFO: `/v3/projects/ebd6e2a101784f3185ccae3929c9f580` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.903602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd6e2a101784f3185ccae3929c9f580)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:49.906789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:49.949063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82968a66-d297-4ce3-a2c4-10039e4ae9ef admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:49.957811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc68726-253e-4b38-a7d5-51f4df81ce47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:49.958582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc68726-253e-4b38-a7d5-51f4df81ce47 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:49.958868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc68726-253e-4b38-a7d5-51f4df81ce47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:49.959232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc68726-253e-4b38-a7d5-51f4df81ce47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:49.977930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc68726-253e-4b38-a7d5-51f4df81ce47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:49.979384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc68726-253e-4b38-a7d5-51f4df81ce47 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:49.983899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd6e2a101784f3185ccae3929c9f580', 'request_id': 'req-308ee55a-7c44-4182-b340-23aaff0f6689'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:49.993414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd6e2a101784f3185ccae3929c9f580', 'request_id': 'req-308ee55a-7c44-4182-b340-23aaff0f6689'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:49.998206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:50.000643 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1011/2040] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:50.000789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd6e2a101784f3185ccae3929c9f580', 'request_id': 'req-308ee55a-7c44-4182-b340-23aaff0f6689'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.018528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] The token cache is being invalidate because project ebd6e2a101784f3185ccae3929c9f580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:50.019957 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.021206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.029921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1030/2041] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:49 2022] DELETE /identity/v3/projects/ebd6e2a101784f3185ccae3929c9f580 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:50.031618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526df41-f42b-4795-8a1a-40c2830bd3ff None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:50.032135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526df41-f42b-4795-8a1a-40c2830bd3ff None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:50.032413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526df41-f42b-4795-8a1a-40c2830bd3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:50.057960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f526df41-f42b-4795-8a1a-40c2830bd3ff None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:50.059751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f526df41-f42b-4795-8a1a-40c2830bd3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:50.091093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:50.092663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:50.208761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee55a-7c44-4182-b340-23aaff0f6689 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:50.227729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:50.228394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:50.228678 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:50.228976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] PATH_INFO: `/v3/projects/3ea7d591d18f446aa46494735343d18c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:50.230748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea7d591d18f446aa46494735343d18c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:50.239012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1012/2042] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:50.239597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:50.245978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23ae52-3489-4c11-9acc-77aa758adec7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:50.246294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23ae52-3489-4c11-9acc-77aa758adec7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:50.246573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23ae52-3489-4c11-9acc-77aa758adec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:50.359366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9b23ae52-3489-4c11-9acc-77aa758adec7 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:50.359366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9b23ae52-3489-4c11-9acc-77aa758adec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:50.365453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea7d591d18f446aa46494735343d18c', 'request_id': 'req-52c07b12-46b1-40de-8c69-804301b5fb7f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.378736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea7d591d18f446aa46494735343d18c', 'request_id': 'req-52c07b12-46b1-40de-8c69-804301b5fb7f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.388395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea7d591d18f446aa46494735343d18c', 'request_id': 'req-52c07b12-46b1-40de-8c69-804301b5fb7f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.413872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] The token cache is being invalidate because project 3ea7d591d18f446aa46494735343d18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:50.414310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.416559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.422963 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1031/2043] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:50 2022] DELETE /identity/v3/projects/3ea7d591d18f446aa46494735343d18c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:50.426921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:50.433742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:50.488393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1013/2044] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:50.493512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23ae52-3489-4c11-9acc-77aa758adec7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:50.524550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23ae52-3489-4c11-9acc-77aa758adec7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:50.540865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fc3a7-8df4-4ae6-80c7-d8ae07ec497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:50.543541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fc3a7-8df4-4ae6-80c7-d8ae07ec497e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:50.543541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fc3a7-8df4-4ae6-80c7-d8ae07ec497e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:50.543541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fc3a7-8df4-4ae6-80c7-d8ae07ec497e admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:50.544027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fc3a7-8df4-4ae6-80c7-d8ae07ec497e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:50.544334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fc3a7-8df4-4ae6-80c7-d8ae07ec497e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:50.550241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c07b12-46b1-40de-8c69-804301b5fb7f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:50.556714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:50.556912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fc3a7-8df4-4ae6-80c7-d8ae07ec497e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:50.557776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:50.558265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:50.558782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] PATH_INFO: `/v3/users/bcc8d68dee3f44d98ad7915e08bb7a9e` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:50.560343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc8d68dee3f44d98ad7915e08bb7a9e)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:50.562679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:50.603260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:50.606061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1014/2045] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:50.609954 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fc3a7-8df4-4ae6-80c7-d8ae07ec497e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:50.647415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fc3a7-8df4-4ae6-80c7-d8ae07ec497e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:50.660009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc8d68dee3f44d98ad7915e08bb7a9e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.660747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc8d68dee3f44d98ad7915e08bb7a9e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.667812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a95c9-252c-458e-a801-16aa183cefe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:50.668883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a95c9-252c-458e-a801-16aa183cefe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:50.669352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a95c9-252c-458e-a801-16aa183cefe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:50.669776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a95c9-252c-458e-a801-16aa183cefe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:50.670717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a95c9-252c-458e-a801-16aa183cefe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:50.672851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a95c9-252c-458e-a801-16aa183cefe4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:50.690221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc8d68dee3f44d98ad7915e08bb7a9e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.712662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1015/2046] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:50 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:50.718102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a95c9-252c-458e-a801-16aa183cefe4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:50.721130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ab6a95c9-252c-458e-a801-16aa183cefe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:50.721590 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc8d68dee3f44d98ad7915e08bb7a9e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.722676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc8d68dee3f44d98ad7915e08bb7a9e'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:50.745324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1032/2047] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:50 2022] DELETE /identity/v3/users/bcc8d68dee3f44d98ad7915e08bb7a9e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:50.771591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:50.802247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a95c9-252c-458e-a801-16aa183cefe4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:50.862381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1d706-0375-4433-8cf7-5a2c507d7913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:50.863054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1d706-0375-4433-8cf7-5a2c507d7913 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:50.863336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1d706-0375-4433-8cf7-5a2c507d7913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:50.863656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1d706-0375-4433-8cf7-5a2c507d7913 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:50.864284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1d706-0375-4433-8cf7-5a2c507d7913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:50.866254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1d706-0375-4433-8cf7-5a2c507d7913 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:50.889500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1016/2048] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:50 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:50.893470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:50.904660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e878694-5647-4f91-888f-550cc8ec7f87 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:50.910046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afafb6-a6d3-445a-aa64-989b33c37393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:50.910576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afafb6-a6d3-445a-aa64-989b33c37393 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:50.910940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afafb6-a6d3-445a-aa64-989b33c37393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:50.911393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afafb6-a6d3-445a-aa64-989b33c37393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:50.912189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afafb6-a6d3-445a-aa64-989b33c37393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:50.914681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afafb6-a6d3-445a-aa64-989b33c37393 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:50.926137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1033/2049] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:50.930774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1d706-0375-4433-8cf7-5a2c507d7913 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:50.941298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1d706-0375-4433-8cf7-5a2c507d7913 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:50.946949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4bbce-1884-4056-9bbc-279870ec050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:50.947592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4bbce-1884-4056-9bbc-279870ec050c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:50.947872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4bbce-1884-4056-9bbc-279870ec050c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:50.948145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4bbce-1884-4056-9bbc-279870ec050c admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:50.948799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4bbce-1884-4056-9bbc-279870ec050c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:50.950849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4bbce-1884-4056-9bbc-279870ec050c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:50.962645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1017/2050] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:50.967788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afafb6-a6d3-445a-aa64-989b33c37393 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:50.980307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afafb6-a6d3-445a-aa64-989b33c37393 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:50.987688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d5c4b-ed18-4fc4-b087-5f11814cc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:50.990964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d5c4b-ed18-4fc4-b087-5f11814cc0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:50.991682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d5c4b-ed18-4fc4-b087-5f11814cc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:50.992063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d5c4b-ed18-4fc4-b087-5f11814cc0bc admin admin] PATH_INFO: `/v3/projects/62f5301e5e1b488588e60531a455fa93/users/1a4437b4a0a6402c9cd0c78087b86b51/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.015072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d5c4b-ed18-4fc4-b087-5f11814cc0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f5301e5e1b488588e60531a455fa93, user_id=1a4437b4a0a6402c9cd0c78087b86b51, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:51.017862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d5c4b-ed18-4fc4-b087-5f11814cc0bc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:51.036312 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1034/2051] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:50 2022] PUT /identity/v3/projects/62f5301e5e1b488588e60531a455fa93/users/1a4437b4a0a6402c9cd0c78087b86b51/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:51.048063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08711e-ceb7-47dd-ac5f-180e4a0249f5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.048442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08711e-ceb7-47dd-ac5f-180e4a0249f5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.048795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08711e-ceb7-47dd-ac5f-180e4a0249f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.104241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dd08711e-ceb7-47dd-ac5f-180e4a0249f5 None None] MFA Rules not processed for user `1a4437b4a0a6402c9cd0c78087b86b51`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:51.105865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dd08711e-ceb7-47dd-ac5f-180e4a0249f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:51.185120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1018/2052] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:51.189245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d5c4b-ed18-4fc4-b087-5f11814cc0bc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:51.268773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfaf80-7344-4ae5-8268-57e2bae43fe2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.269516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfaf80-7344-4ae5-8268-57e2bae43fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.270709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfaf80-7344-4ae5-8268-57e2bae43fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.293951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d5c4b-ed18-4fc4-b087-5f11814cc0bc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:51.300798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef865a45-54f7-43b6-9376-baf5a2e19b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:51.302746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865a45-54f7-43b6-9376-baf5a2e19b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.302746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865a45-54f7-43b6-9376-baf5a2e19b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.302746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865a45-54f7-43b6-9376-baf5a2e19b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.304361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef865a45-54f7-43b6-9376-baf5a2e19b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:51.307584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef865a45-54f7-43b6-9376-baf5a2e19b46 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:51.317141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-edbfaf80-7344-4ae5-8268-57e2bae43fe2 None None] MFA Rules not processed for user `4d23a86c89cd44dbb39dbc7396b98e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:51.318466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-edbfaf80-7344-4ae5-8268-57e2bae43fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:51.353340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1035/2053] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:51 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:51.357724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef865a45-54f7-43b6-9376-baf5a2e19b46 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:51.381987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:51.425223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:51.436449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1019/2054] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:51.451899 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfaf80-7344-4ae5-8268-57e2bae43fe2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:51.454499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-edbfaf80-7344-4ae5-8268-57e2bae43fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:51.470890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef865a45-54f7-43b6-9376-baf5a2e19b46 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:51.477473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642acef0-71db-467e-9e48-f8061d9e79fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:51.478094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642acef0-71db-467e-9e48-f8061d9e79fb admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.479089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642acef0-71db-467e-9e48-f8061d9e79fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.479336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642acef0-71db-467e-9e48-f8061d9e79fb admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.480082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642acef0-71db-467e-9e48-f8061d9e79fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:51.482477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642acef0-71db-467e-9e48-f8061d9e79fb admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:51.558844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfaf80-7344-4ae5-8268-57e2bae43fe2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:51.564890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1036/2055] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:51 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:51.566306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642acef0-71db-467e-9e48-f8061d9e79fb admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:51.569049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-642acef0-71db-467e-9e48-f8061d9e79fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:51.583835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642acef0-71db-467e-9e48-f8061d9e79fb admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:51.591815 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:51.597088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.598398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.599000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] PATH_INFO: `/v3/projects/306567f7e09744afbb43b095b83ea38c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.601286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306567f7e09744afbb43b095b83ea38c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:51.603487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:51.629910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161d2a9-27e5-4000-85c4-796cde194f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:51.630460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d2a9-27e5-4000-85c4-796cde194f2d service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.630749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d2a9-27e5-4000-85c4-796cde194f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.631025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d2a9-27e5-4000-85c4-796cde194f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.669540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306567f7e09744afbb43b095b83ea38c', 'request_id': 'req-369a4208-fa9d-4ef8-9b74-8310954975b9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:51.677699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306567f7e09744afbb43b095b83ea38c', 'request_id': 'req-369a4208-fa9d-4ef8-9b74-8310954975b9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:51.684322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306567f7e09744afbb43b095b83ea38c', 'request_id': 'req-369a4208-fa9d-4ef8-9b74-8310954975b9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:51.700879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] The token cache is being invalidate because project 306567f7e09744afbb43b095b83ea38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:51.701446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:51.702109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:51.713049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1037/2056] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:51 2022] DELETE /identity/v3/projects/306567f7e09744afbb43b095b83ea38c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:51.713049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:51.713049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:51.713473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161d2a9-27e5-4000-85c4-796cde194f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:51.713473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161d2a9-27e5-4000-85c4-796cde194f2d service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:51.720783 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1020/2057] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:51.727387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161d2a9-27e5-4000-85c4-796cde194f2d service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:51.744566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161d2a9-27e5-4000-85c4-796cde194f2d service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:51.813420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:51.813709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a4208-fa9d-4ef8-9b74-8310954975b9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:51.824166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41fc0a-2ea6-43e7-8f9f-175254d21b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:51.825145 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41fc0a-2ea6-43e7-8f9f-175254d21b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.825570 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41fc0a-2ea6-43e7-8f9f-175254d21b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.825984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41fc0a-2ea6-43e7-8f9f-175254d21b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.826776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41fc0a-2ea6-43e7-8f9f-175254d21b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:51.829392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41fc0a-2ea6-43e7-8f9f-175254d21b51 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:51.830430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:51.831313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.831808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.832164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] PATH_INFO: `/v3/users/97f9a1d6ec514546ae71d943577d8a2c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.833449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f9a1d6ec514546ae71d943577d8a2c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:51.836727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:51.846530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1038/2058] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:51.852869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41fc0a-2ea6-43e7-8f9f-175254d21b51 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:51.883582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41fc0a-2ea6-43e7-8f9f-175254d21b51 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:51.896156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db4631-81a9-490c-87dd-ed7c8e40fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:51.896931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db4631-81a9-490c-87dd-ed7c8e40fa2b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.897138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db4631-81a9-490c-87dd-ed7c8e40fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.897475 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db4631-81a9-490c-87dd-ed7c8e40fa2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.898854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db4631-81a9-490c-87dd-ed7c8e40fa2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:51.900990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db4631-81a9-490c-87dd-ed7c8e40fa2b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:51.924868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1039/2059] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:51.925946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db4631-81a9-490c-87dd-ed7c8e40fa2b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:51.927205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f9a1d6ec514546ae71d943577d8a2c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:51.941214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f9a1d6ec514546ae71d943577d8a2c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:51.941316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db4631-81a9-490c-87dd-ed7c8e40fa2b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:51.941407 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f9a1d6ec514546ae71d943577d8a2c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:51.946861 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c53d2c-d7bc-4938-94ee-a924aff9a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:51.947614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c53d2c-d7bc-4938-94ee-a924aff9a58d admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.947921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c53d2c-d7bc-4938-94ee-a924aff9a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.948218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c53d2c-d7bc-4938-94ee-a924aff9a58d admin admin] PATH_INFO: `/v3/projects/bbf0dae60dc1476ea5fbb9ce90f07832/users/a274737fb07e4882a8c2c91af84d7feb/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:51.955186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f9a1d6ec514546ae71d943577d8a2c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:51.966033 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c53d2c-d7bc-4938-94ee-a924aff9a58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf0dae60dc1476ea5fbb9ce90f07832, user_id=a274737fb07e4882a8c2c91af84d7feb, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:51.968379 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-76ef3a7c-d524-4e56-acd2-df0b93a6d324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f9a1d6ec514546ae71d943577d8a2c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:51.969693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c53d2c-d7bc-4938-94ee-a924aff9a58d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:51.976962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1021/2060] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:51 2022] DELETE /identity/v3/users/97f9a1d6ec514546ae71d943577d8a2c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:51.986022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1040/2061] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:51 2022] PUT /identity/v3/projects/bbf0dae60dc1476ea5fbb9ce90f07832/users/a274737fb07e4882a8c2c91af84d7feb/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:51.996982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc837c-3ea4-4271-bdee-5ea94e540614 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:51.997275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc837c-3ea4-4271-bdee-5ea94e540614 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:51.997591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc837c-3ea4-4271-bdee-5ea94e540614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.035122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b9cc837c-3ea4-4271-bdee-5ea94e540614 None None] MFA Rules not processed for user `a274737fb07e4882a8c2c91af84d7feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:52.036509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b9cc837c-3ea4-4271-bdee-5ea94e540614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:52.146514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1022/2062] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:52.151537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c53d2c-d7bc-4938-94ee-a924aff9a58d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.154831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-05c53d2c-d7bc-4938-94ee-a924aff9a58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:52.186106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:52.248427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c53d2c-d7bc-4938-94ee-a924aff9a58d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:52.254699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ca776-5148-4670-b04e-7dcd3b467d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:52.255573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ca776-5148-4670-b04e-7dcd3b467d45 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.256061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ca776-5148-4670-b04e-7dcd3b467d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.256517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ca776-5148-4670-b04e-7dcd3b467d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.257981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ca776-5148-4670-b04e-7dcd3b467d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:52.260052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ca776-5148-4670-b04e-7dcd3b467d45 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:52.293827 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1041/2063] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:52 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:52.298135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc837c-3ea4-4271-bdee-5ea94e540614 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.312361 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc837c-3ea4-4271-bdee-5ea94e540614 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:52.327962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ca776-5148-4670-b04e-7dcd3b467d45 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.329776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0b6ca776-5148-4670-b04e-7dcd3b467d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:52.386324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:52.394319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa3ee7-2eeb-4c1e-97d7-77da37001fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:52.395036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa3ee7-2eeb-4c1e-97d7-77da37001fed admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.395372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa3ee7-2eeb-4c1e-97d7-77da37001fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.395873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa3ee7-2eeb-4c1e-97d7-77da37001fed admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.396739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa3ee7-2eeb-4c1e-97d7-77da37001fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:52.399420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa3ee7-2eeb-4c1e-97d7-77da37001fed admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:52.400496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ca776-5148-4670-b04e-7dcd3b467d45 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:52.405129 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:52.405745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.406022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.406292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] PATH_INFO: `/v3/projects/3041fcc396d44d418447dfd5556fb7c3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.407416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3041fcc396d44d418447dfd5556fb7c3)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:52.409322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:52.421990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1023/2064] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:52 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:52.426004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa3ee7-2eeb-4c1e-97d7-77da37001fed admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.436078 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa3ee7-2eeb-4c1e-97d7-77da37001fed admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:52.441409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24f96d-b250-4894-ae96-b3ef1f8168f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:52.441951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24f96d-b250-4894-ae96-b3ef1f8168f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.442226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24f96d-b250-4894-ae96-b3ef1f8168f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.443013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24f96d-b250-4894-ae96-b3ef1f8168f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.443662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24f96d-b250-4894-ae96-b3ef1f8168f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:52.445590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24f96d-b250-4894-ae96-b3ef1f8168f0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:52.459478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1024/2065] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:52.459614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3041fcc396d44d418447dfd5556fb7c3', 'request_id': 'req-bf66b045-db6c-4838-be8d-ac923003bec5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:52.460528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24f96d-b250-4894-ae96-b3ef1f8168f0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.464181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3041fcc396d44d418447dfd5556fb7c3', 'request_id': 'req-bf66b045-db6c-4838-be8d-ac923003bec5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:52.469734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3041fcc396d44d418447dfd5556fb7c3', 'request_id': 'req-bf66b045-db6c-4838-be8d-ac923003bec5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:52.470139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24f96d-b250-4894-ae96-b3ef1f8168f0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:52.484098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] The token cache is being invalidate because project 3041fcc396d44d418447dfd5556fb7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:52.484392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:52.485069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bf66b045-db6c-4838-be8d-ac923003bec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:52.486627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1042/2066] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:52 2022] DELETE /identity/v3/projects/3041fcc396d44d418447dfd5556fb7c3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:52.493325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781c2d-fceb-4c31-ba5f-9f7b21f28597 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.493722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781c2d-fceb-4c31-ba5f-9f7b21f28597 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.494103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781c2d-fceb-4c31-ba5f-9f7b21f28597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.516380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-61781c2d-fceb-4c31-ba5f-9f7b21f28597 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:52.517776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-61781c2d-fceb-4c31-ba5f-9f7b21f28597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:52.528360 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574de5-d136-4248-bb11-aab84564730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:52.529049 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574de5-d136-4248-bb11-aab84564730e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.529329 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574de5-d136-4248-bb11-aab84564730e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.529595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574de5-d136-4248-bb11-aab84564730e admin admin] PATH_INFO: `/v3/projects/8f13273794994d14b6b0af579c13c2a6/users/1915e9f972b24d3faba0696856cc663d/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.549184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:52.551322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec574de5-d136-4248-bb11-aab84564730e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f13273794994d14b6b0af579c13c2a6, user_id=1915e9f972b24d3faba0696856cc663d, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:52.554880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec574de5-d136-4248-bb11-aab84564730e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:52.573134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1025/2067] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:52 2022] PUT /identity/v3/projects/8f13273794994d14b6b0af579c13c2a6/users/1915e9f972b24d3faba0696856cc663d/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:52.576922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574de5-d136-4248-bb11-aab84564730e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.578567 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ec574de5-d136-4248-bb11-aab84564730e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:52.586655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1043/2068] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:52.595863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1c12e-2c85-4e61-96c3-6f21f609a93c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.596151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1c12e-2c85-4e61-96c3-6f21f609a93c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.596425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1c12e-2c85-4e61-96c3-6f21f609a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.616677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-10f1c12e-2c85-4e61-96c3-6f21f609a93c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:52.617947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-10f1c12e-2c85-4e61-96c3-6f21f609a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:52.643025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574de5-d136-4248-bb11-aab84564730e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:52.648969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b3a2-794b-4e41-a171-9cf2baf6fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:52.653279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b3a2-794b-4e41-a171-9cf2baf6fe7a admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.653576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b3a2-794b-4e41-a171-9cf2baf6fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.653856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b3a2-794b-4e41-a171-9cf2baf6fe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.654637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994b3a2-794b-4e41-a171-9cf2baf6fe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:52.656251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994b3a2-794b-4e41-a171-9cf2baf6fe7a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:52.671542 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1026/2069] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:52.673412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b3a2-794b-4e41-a171-9cf2baf6fe7a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.683637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1044/2070] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:52.686058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b3a2-794b-4e41-a171-9cf2baf6fe7a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:52.688028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1c12e-2c85-4e61-96c3-6f21f609a93c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.691851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6b1ab-ef7a-4385-9adc-38beba470811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:52.692483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6b1ab-ef7a-4385-9adc-38beba470811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.692881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6b1ab-ef7a-4385-9adc-38beba470811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.693129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6b1ab-ef7a-4385-9adc-38beba470811 admin admin] PATH_INFO: `/v3/projects/8f13273794994d14b6b0af579c13c2a6/users/1915e9f972b24d3faba0696856cc663d/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.697471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6b1ab-ef7a-4385-9adc-38beba470811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f13273794994d14b6b0af579c13c2a6, user_id=1915e9f972b24d3faba0696856cc663d, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:52.701429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1c12e-2c85-4e61-96c3-6f21f609a93c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:52.703687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6b1ab-ef7a-4385-9adc-38beba470811 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:52.706376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c343d24-92dd-4815-b611-f579c6489e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:52.706975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c343d24-92dd-4815-b611-f579c6489e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.707257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c343d24-92dd-4815-b611-f579c6489e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.707530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c343d24-92dd-4815-b611-f579c6489e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.708631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c343d24-92dd-4815-b611-f579c6489e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:52.708631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c343d24-92dd-4815-b611-f579c6489e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:52.710154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c343d24-92dd-4815-b611-f579c6489e64 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:52.719947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1027/2071] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:52 2022] PUT /identity/v3/projects/8f13273794994d14b6b0af579c13c2a6/users/1915e9f972b24d3faba0696856cc663d/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:52.732787 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648aec-3d92-4462-b725-c011cc45f4b7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.733237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648aec-3d92-4462-b725-c011cc45f4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.733531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648aec-3d92-4462-b725-c011cc45f4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.749397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1045/2072] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:33:52.755634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c343d24-92dd-4815-b611-f579c6489e64 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.767688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f1648aec-3d92-4462-b725-c011cc45f4b7 None None] MFA Rules not processed for user `1915e9f972b24d3faba0696856cc663d`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:52.768986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f1648aec-3d92-4462-b725-c011cc45f4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:52.776465 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c343d24-92dd-4815-b611-f579c6489e64 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:52.804964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:52.865092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1028/2073] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:52.878123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1648aec-3d92-4462-b725-c011cc45f4b7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.879648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f1648aec-3d92-4462-b725-c011cc45f4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:52.898331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db650d-a36c-492b-815e-1a8a3cb7738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:52.899589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db650d-a36c-492b-815e-1a8a3cb7738a admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:52.900067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db650d-a36c-492b-815e-1a8a3cb7738a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:52.900436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db650d-a36c-492b-815e-1a8a3cb7738a admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:52.901285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db650d-a36c-492b-815e-1a8a3cb7738a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:52.903442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db650d-a36c-492b-815e-1a8a3cb7738a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:52.955883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1046/2074] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:52 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:52.960112 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db650d-a36c-492b-815e-1a8a3cb7738a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:52.960414 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1648aec-3d92-4462-b725-c011cc45f4b7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.035104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:53.035910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e372ff1-8d34-4f5d-9c51-c98c0c28f415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.036657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e372ff1-8d34-4f5d-9c51-c98c0c28f415 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.036980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e372ff1-8d34-4f5d-9c51-c98c0c28f415 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.037410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e372ff1-8d34-4f5d-9c51-c98c0c28f415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.040189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2e372ff1-8d34-4f5d-9c51-c98c0c28f415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:53.059357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db650d-a36c-492b-815e-1a8a3cb7738a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.064991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdaafd-417a-43ba-8d3c-72498da02805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.065572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdaafd-417a-43ba-8d3c-72498da02805 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.066096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdaafd-417a-43ba-8d3c-72498da02805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.066241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdaafd-417a-43ba-8d3c-72498da02805 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.066910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdaafd-417a-43ba-8d3c-72498da02805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.068988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdaafd-417a-43ba-8d3c-72498da02805 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.099111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1047/2075] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:52 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:53.100253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdaafd-417a-43ba-8d3c-72498da02805 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:53.112164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdaafd-417a-43ba-8d3c-72498da02805 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.119764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e558f0-5064-4981-aabc-b3a5456d043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.120550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e558f0-5064-4981-aabc-b3a5456d043e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.121141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e558f0-5064-4981-aabc-b3a5456d043e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.121481 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e558f0-5064-4981-aabc-b3a5456d043e admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.122383 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e558f0-5064-4981-aabc-b3a5456d043e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.123972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e558f0-5064-4981-aabc-b3a5456d043e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.130921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e372ff1-8d34-4f5d-9c51-c98c0c28f415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.133013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e372ff1-8d34-4f5d-9c51-c98c0c28f415 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.136760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1048/2076] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:53.140616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e558f0-5064-4981-aabc-b3a5456d043e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:53.152509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e558f0-5064-4981-aabc-b3a5456d043e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.155396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1029/2077] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:53.178733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceba1cf-4ab0-4a92-8e17-adb6585b1e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.180003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceba1cf-4ab0-4a92-8e17-adb6585b1e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.180351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceba1cf-4ab0-4a92-8e17-adb6585b1e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.180724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceba1cf-4ab0-4a92-8e17-adb6585b1e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.181759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceba1cf-4ab0-4a92-8e17-adb6585b1e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.183245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceba1cf-4ab0-4a92-8e17-adb6585b1e12 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.190904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389da0-7d64-4b7e-9732-e05310ce524b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.191216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389da0-7d64-4b7e-9732-e05310ce524b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.191588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389da0-7d64-4b7e-9732-e05310ce524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.195934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1049/2078] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:33:53.200646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceba1cf-4ab0-4a92-8e17-adb6585b1e12 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:53.213025 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceba1cf-4ab0-4a92-8e17-adb6585b1e12 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.216156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f6389da0-7d64-4b7e-9732-e05310ce524b None None] MFA Rules not processed for user `4d23a86c89cd44dbb39dbc7396b98e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:53.217397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f6389da0-7d64-4b7e-9732-e05310ce524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:53.218643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466fbdf-9130-4c82-9431-df8edbd062bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.219405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466fbdf-9130-4c82-9431-df8edbd062bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.219687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466fbdf-9130-4c82-9431-df8edbd062bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.219959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466fbdf-9130-4c82-9431-df8edbd062bf admin admin] PATH_INFO: `/v3/projects/b5826b998b9645e7b79552fcd3192329/users/83b8bafb21484a97b2ed35f84f0de687/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.236078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466fbdf-9130-4c82-9431-df8edbd062bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5826b998b9645e7b79552fcd3192329, user_id=83b8bafb21484a97b2ed35f84f0de687, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.239242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466fbdf-9130-4c82-9431-df8edbd062bf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.255602 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:53.256436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1050/2079] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:53 2022] PUT /identity/v3/projects/b5826b998b9645e7b79552fcd3192329/users/83b8bafb21484a97b2ed35f84f0de687/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:53.267906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987e480-588f-4a7d-bbba-196d579754cd None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.268420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987e480-588f-4a7d-bbba-196d579754cd None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.268694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987e480-588f-4a7d-bbba-196d579754cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.294967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1030/2080] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:53.302695 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d987e480-588f-4a7d-bbba-196d579754cd None None] MFA Rules not processed for user `83b8bafb21484a97b2ed35f84f0de687`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:53.304627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d987e480-588f-4a7d-bbba-196d579754cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:53.393474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1051/2081] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:53.397881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6389da0-7d64-4b7e-9732-e05310ce524b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:53.412191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6389da0-7d64-4b7e-9732-e05310ce524b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.491873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9410-9578-497b-b8bb-0b60e820aab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.492509 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9410-9578-497b-b8bb-0b60e820aab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.495262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9410-9578-497b-b8bb-0b60e820aab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.495547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9410-9578-497b-b8bb-0b60e820aab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.497444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab9410-9578-497b-b8bb-0b60e820aab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.500651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab9410-9578-497b-b8bb-0b60e820aab9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.551255 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1031/2082] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:53 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:53.553721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987e480-588f-4a7d-bbba-196d579754cd None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:53.566624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987e480-588f-4a7d-bbba-196d579754cd None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.633742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a9e8e-866b-4119-bbd3-fda424218663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.634489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a9e8e-866b-4119-bbd3-fda424218663 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.634887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a9e8e-866b-4119-bbd3-fda424218663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.635080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a9e8e-866b-4119-bbd3-fda424218663 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.635691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a9e8e-866b-4119-bbd3-fda424218663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.637826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a9e8e-866b-4119-bbd3-fda424218663 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.662103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1052/2083] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:53 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:53.666251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9410-9578-497b-b8bb-0b60e820aab9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:53.677426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9410-9578-497b-b8bb-0b60e820aab9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.683017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb6d9-1eb4-4526-9dd9-a5ecea26a277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.683535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb6d9-1eb4-4526-9dd9-a5ecea26a277 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.683807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb6d9-1eb4-4526-9dd9-a5ecea26a277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.684086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb6d9-1eb4-4526-9dd9-a5ecea26a277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.684755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb6d9-1eb4-4526-9dd9-a5ecea26a277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.686376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb6d9-1eb4-4526-9dd9-a5ecea26a277 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.698276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1032/2084] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:53.702591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a9e8e-866b-4119-bbd3-fda424218663 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:53.712875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a9e8e-866b-4119-bbd3-fda424218663 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.718164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4bb2-df04-4811-a24c-fc55eaddcbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.718852 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4bb2-df04-4811-a24c-fc55eaddcbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.719195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4bb2-df04-4811-a24c-fc55eaddcbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.719411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4bb2-df04-4811-a24c-fc55eaddcbd4 admin admin] PATH_INFO: `/v3/projects/41c83bca6e70494d82723d0504717347/users/a6772c334c494db392404e46070c77ef/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.730506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:53.738918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df4bb2-df04-4811-a24c-fc55eaddcbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c83bca6e70494d82723d0504717347, user_id=a6772c334c494db392404e46070c77ef, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.742229 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df4bb2-df04-4811-a24c-fc55eaddcbd4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.759594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1053/2085] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:53 2022] PUT /identity/v3/projects/41c83bca6e70494d82723d0504717347/users/a6772c334c494db392404e46070c77ef/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:53.763519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb6d9-1eb4-4526-9dd9-a5ecea26a277 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:53.774478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb6d9-1eb4-4526-9dd9-a5ecea26a277 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.843337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82929a73-eaba-47b1-8442-6fd9d9f45c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.844267 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82929a73-eaba-47b1-8442-6fd9d9f45c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.844547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82929a73-eaba-47b1-8442-6fd9d9f45c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.844821 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82929a73-eaba-47b1-8442-6fd9d9f45c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.845834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82929a73-eaba-47b1-8442-6fd9d9f45c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.847093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82929a73-eaba-47b1-8442-6fd9d9f45c40 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.858679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1033/2086] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:53.862917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4bb2-df04-4811-a24c-fc55eaddcbd4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:53.874883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4bb2-df04-4811-a24c-fc55eaddcbd4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:53.880045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24801b4-f12d-4110-ae5c-14cefb29298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:53.880804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24801b4-f12d-4110-ae5c-14cefb29298b admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.881206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24801b4-f12d-4110-ae5c-14cefb29298b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.881574 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24801b4-f12d-4110-ae5c-14cefb29298b admin admin] PATH_INFO: `/v3/projects/41c83bca6e70494d82723d0504717347/users/a6772c334c494db392404e46070c77ef/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.883613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24801b4-f12d-4110-ae5c-14cefb29298b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c83bca6e70494d82723d0504717347, user_id=a6772c334c494db392404e46070c77ef, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:53.886449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24801b4-f12d-4110-ae5c-14cefb29298b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:53.898252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1054/2087] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:53 2022] PUT /identity/v3/projects/41c83bca6e70494d82723d0504717347/users/a6772c334c494db392404e46070c77ef/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:53.909279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddabee-3020-439a-8683-01ad99a25837 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:53.909562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddabee-3020-439a-8683-01ad99a25837 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:53.909832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddabee-3020-439a-8683-01ad99a25837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:53.938457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-18ddabee-3020-439a-8683-01ad99a25837 None None] MFA Rules not processed for user `a6772c334c494db392404e46070c77ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:53.939667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-18ddabee-3020-439a-8683-01ad99a25837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:53.985233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:54.018866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1034/2088] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:54.030659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24801b4-f12d-4110-ae5c-14cefb29298b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:54.032360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f24801b4-f12d-4110-ae5c-14cefb29298b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:54.101430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddabee-3020-439a-8683-01ad99a25837 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:54.102970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-18ddabee-3020-439a-8683-01ad99a25837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:54.108505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24801b4-f12d-4110-ae5c-14cefb29298b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:54.112167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888cb1-d0fe-4903-8c35-3c187db0e1c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:54.112778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888cb1-d0fe-4903-8c35-3c187db0e1c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:54.113318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888cb1-d0fe-4903-8c35-3c187db0e1c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:54.113608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888cb1-d0fe-4903-8c35-3c187db0e1c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:54.125060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff888cb1-d0fe-4903-8c35-3c187db0e1c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:54.126405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff888cb1-d0fe-4903-8c35-3c187db0e1c9 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:54.137578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1055/2089] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:54.200941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddabee-3020-439a-8683-01ad99a25837 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:54.207586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:54.208378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:54.208728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:54.209096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] PATH_INFO: `/v3/users/a6b457ccc32f48749f1739008cfad194` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:54.210330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b457ccc32f48749f1739008cfad194)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:54.213412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:54.271784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888cb1-d0fe-4903-8c35-3c187db0e1c9 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:54.283734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b457ccc32f48749f1739008cfad194'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:54.284178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888cb1-d0fe-4903-8c35-3c187db0e1c9 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:54.289505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fdaa3-0d3c-4938-82b2-c31001bc5766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:54.290440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fdaa3-0d3c-4938-82b2-c31001bc5766 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:54.290726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fdaa3-0d3c-4938-82b2-c31001bc5766 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:54.291606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fdaa3-0d3c-4938-82b2-c31001bc5766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:54.293258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b457ccc32f48749f1739008cfad194'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:54.294000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b457ccc32f48749f1739008cfad194'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:54.312286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b457ccc32f48749f1739008cfad194'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:54.332050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-041047c2-1572-4b59-bbfc-a848ba717507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b457ccc32f48749f1739008cfad194'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:54.339132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1035/2090] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:54 2022] DELETE /identity/v3/users/a6b457ccc32f48749f1739008cfad194 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:33:54.343294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f580b-68c1-4592-9f7d-79c9150d4dfc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:54.343650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f580b-68c1-4592-9f7d-79c9150d4dfc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:54.345030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f580b-68c1-4592-9f7d-79c9150d4dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:54.375799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b36f580b-68c1-4592-9f7d-79c9150d4dfc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:54.377325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b36f580b-68c1-4592-9f7d-79c9150d4dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:54.383423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fdaa3-0d3c-4938-82b2-c31001bc5766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:54.384973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fdaa3-0d3c-4938-82b2-c31001bc5766 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:54.396866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1056/2091] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:54.448714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:54.475308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1036/2092] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:33:54.499759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fdaa3-0d3c-4938-82b2-c31001bc5766 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:54.501991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-be6fdaa3-0d3c-4938-82b2-c31001bc5766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:54.690249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fdaa3-0d3c-4938-82b2-c31001bc5766 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:54.758746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:54.802876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af813b-c19e-4018-afef-5c80c3c9e703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:54.803842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af813b-c19e-4018-afef-5c80c3c9e703 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:54.804309 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af813b-c19e-4018-afef-5c80c3c9e703 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:54.804784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af813b-c19e-4018-afef-5c80c3c9e703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:54.826412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af813b-c19e-4018-afef-5c80c3c9e703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:54.828043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af813b-c19e-4018-afef-5c80c3c9e703 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:54.858067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f580b-68c1-4592-9f7d-79c9150d4dfc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:54.858067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b36f580b-68c1-4592-9f7d-79c9150d4dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:54.872458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f580b-68c1-4592-9f7d-79c9150d4dfc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:54.878371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:54.879039 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:54.879350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:54.879846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] PATH_INFO: `/v3/users/83b8bafb21484a97b2ed35f84f0de687` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:54.881997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b8bafb21484a97b2ed35f84f0de687)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:54.884007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:54.889343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1057/2093] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:54.976879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b8bafb21484a97b2ed35f84f0de687'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:54.990231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b8bafb21484a97b2ed35f84f0de687'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:54.990888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b8bafb21484a97b2ed35f84f0de687'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.007878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b8bafb21484a97b2ed35f84f0de687'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.042630 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b8bafb21484a97b2ed35f84f0de687'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.051061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1037/2094] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:54 2022] DELETE /identity/v3/users/83b8bafb21484a97b2ed35f84f0de687 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:55.055762 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a888861-0366-4a34-b23c-72847fb520cd None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:55.056107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a888861-0366-4a34-b23c-72847fb520cd None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:55.056386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a888861-0366-4a34-b23c-72847fb520cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:55.103544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:55.104721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1a888861-0366-4a34-b23c-72847fb520cd None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:55.105193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:55.105956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1a888861-0366-4a34-b23c-72847fb520cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:55.200429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c123e-1c67-4953-94ca-49bfb1b7f883 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:55.207489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b0b94-6004-422a-9df5-1beecbe0d12b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:55.208312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0b94-6004-422a-9df5-1beecbe0d12b service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:55.208670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0b94-6004-422a-9df5-1beecbe0d12b service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:55.209050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0b94-6004-422a-9df5-1beecbe0d12b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:55.211832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8a0b0b94-6004-422a-9df5-1beecbe0d12b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:55.262196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1058/2095] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:55.273225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a888861-0366-4a34-b23c-72847fb520cd None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:55.276969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1a888861-0366-4a34-b23c-72847fb520cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:55.316150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b0b94-6004-422a-9df5-1beecbe0d12b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:55.318052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b0b94-6004-422a-9df5-1beecbe0d12b service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:55.345905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1038/2096] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:55.347515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b0b94-6004-422a-9df5-1beecbe0d12b service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:55.352698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8a0b0b94-6004-422a-9df5-1beecbe0d12b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:55.375240 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b0b94-6004-422a-9df5-1beecbe0d12b service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:55.385449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:55.385685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a888861-0366-4a34-b23c-72847fb520cd None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:55.386503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:55.386942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:55.387268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] PATH_INFO: `/v3/projects/35b629161b1f408986316ac4274f1b02` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:55.388429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b629161b1f408986316ac4274f1b02)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:55.389906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350129e7-4136-43ad-8cac-0d5fdc8d8cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:55.390817 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350129e7-4136-43ad-8cac-0d5fdc8d8cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:55.390945 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:55.391688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350129e7-4136-43ad-8cac-0d5fdc8d8cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:55.392128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350129e7-4136-43ad-8cac-0d5fdc8d8cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:55.405551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350129e7-4136-43ad-8cac-0d5fdc8d8cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:55.408247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350129e7-4136-43ad-8cac-0d5fdc8d8cb8 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:55.420996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1059/2097] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:33:55.424763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:55.473076 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b629161b1f408986316ac4274f1b02', 'request_id': 'req-3c71446c-ba24-41ac-a62c-48ac91f418fb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.481297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b629161b1f408986316ac4274f1b02', 'request_id': 'req-3c71446c-ba24-41ac-a62c-48ac91f418fb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.488327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b629161b1f408986316ac4274f1b02', 'request_id': 'req-3c71446c-ba24-41ac-a62c-48ac91f418fb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.518811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] The token cache is being invalidate because project 35b629161b1f408986316ac4274f1b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:55.519441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.523657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3c71446c-ba24-41ac-a62c-48ac91f418fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.525647 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1039/2098] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:55 2022] DELETE /identity/v3/projects/35b629161b1f408986316ac4274f1b02 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:55.531458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a717c76-97ee-488b-a7eb-eff801b308bb None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:55.532269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a717c76-97ee-488b-a7eb-eff801b308bb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:55.532551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a717c76-97ee-488b-a7eb-eff801b308bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:55.564122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6a717c76-97ee-488b-a7eb-eff801b308bb None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:55.566421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6a717c76-97ee-488b-a7eb-eff801b308bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:55.688619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1060/2099] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:55.690823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f9fcd-5ea0-491e-be91-37b1a4f0fcae None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:55.691612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f9fcd-5ea0-491e-be91-37b1a4f0fcae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:55.692056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f9fcd-5ea0-491e-be91-37b1a4f0fcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:55.719872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ec6f9fcd-5ea0-491e-be91-37b1a4f0fcae None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:55.721353 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ec6f9fcd-5ea0-491e-be91-37b1a4f0fcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:55.737410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1040/2100] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:55.742316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a717c76-97ee-488b-a7eb-eff801b308bb None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:55.765503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a717c76-97ee-488b-a7eb-eff801b308bb None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:55.771173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46291cd8-7883-4771-9d55-1c0b215144c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:55.775151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46291cd8-7883-4771-9d55-1c0b215144c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:55.775151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46291cd8-7883-4771-9d55-1c0b215144c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:55.775151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46291cd8-7883-4771-9d55-1c0b215144c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:55.775151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46291cd8-7883-4771-9d55-1c0b215144c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:55.775151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46291cd8-7883-4771-9d55-1c0b215144c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:55.776778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f9fcd-5ea0-491e-be91-37b1a4f0fcae None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:55.777521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46291cd8-7883-4771-9d55-1c0b215144c9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:55.778688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ec6f9fcd-5ea0-491e-be91-37b1a4f0fcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:55.800994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1061/2101] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:55.805110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f9fcd-5ea0-491e-be91-37b1a4f0fcae None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:55.805380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46291cd8-7883-4771-9d55-1c0b215144c9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:55.811139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:55.811800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:55.812597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:55.812854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] PATH_INFO: `/v3/projects/b5826b998b9645e7b79552fcd3192329` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:55.814339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5826b998b9645e7b79552fcd3192329)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:55.816456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:55.822754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:55.828338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46291cd8-7883-4771-9d55-1c0b215144c9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:55.838441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb24d35-2fc1-4c5d-b0ee-b47106467d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:55.839307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24d35-2fc1-4c5d-b0ee-b47106467d34 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:55.839776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24d35-2fc1-4c5d-b0ee-b47106467d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:55.840223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24d35-2fc1-4c5d-b0ee-b47106467d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:55.841030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb24d35-2fc1-4c5d-b0ee-b47106467d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:55.843081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb24d35-2fc1-4c5d-b0ee-b47106467d34 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:55.890795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1062/2102] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:55 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:55.898528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb24d35-2fc1-4c5d-b0ee-b47106467d34 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:55.909393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5826b998b9645e7b79552fcd3192329', 'request_id': 'req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.924300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5826b998b9645e7b79552fcd3192329', 'request_id': 'req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.936591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5826b998b9645e7b79552fcd3192329', 'request_id': 'req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.959649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] The token cache is being invalidate because project b5826b998b9645e7b79552fcd3192329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:55.961776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.962636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:55.964315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1041/2103] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:55 2022] DELETE /identity/v3/projects/b5826b998b9645e7b79552fcd3192329 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:55.968475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:55.970067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:56.060912 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb24d35-2fc1-4c5d-b0ee-b47106467d34 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:56.074529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ffc96-3154-49bc-8d77-99b489b2d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:56.076432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ffc96-3154-49bc-8d77-99b489b2d205 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:56.076727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ffc96-3154-49bc-8d77-99b489b2d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:56.077591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ffc96-3154-49bc-8d77-99b489b2d205 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:56.082288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ffc96-3154-49bc-8d77-99b489b2d205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:56.090089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ffc96-3154-49bc-8d77-99b489b2d205 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:56.120348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1063/2104] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:55 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:56.121311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ffc96-3154-49bc-8d77-99b489b2d205 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:56.123032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ee5ffc96-3154-49bc-8d77-99b489b2d205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:56.128796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5fc96-8733-4280-8f4f-f9ba4a12e576 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:56.138115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:56.138772 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:56.140939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:56.141267 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] PATH_INFO: `/v3/users/a6772c334c494db392404e46070c77ef` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:56.142697 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ffc96-3154-49bc-8d77-99b489b2d205 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:56.144108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6772c334c494db392404e46070c77ef)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:56.147753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:56.149788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ef63a-0a14-4caf-8a13-7e7e08813a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:56.150887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef63a-0a14-4caf-8a13-7e7e08813a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:56.150887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef63a-0a14-4caf-8a13-7e7e08813a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:56.151055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef63a-0a14-4caf-8a13-7e7e08813a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:56.151683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ef63a-0a14-4caf-8a13-7e7e08813a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:56.153487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ef63a-0a14-4caf-8a13-7e7e08813a9b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:56.171320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1064/2105] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:56.172514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ef63a-0a14-4caf-8a13-7e7e08813a9b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:56.192724 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ef63a-0a14-4caf-8a13-7e7e08813a9b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:56.228984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad00f-f4fb-4657-b40f-04af35e0e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:56.231506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad00f-f4fb-4657-b40f-04af35e0e159 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:56.233141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad00f-f4fb-4657-b40f-04af35e0e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:56.233986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad00f-f4fb-4657-b40f-04af35e0e159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:56.234758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ad00f-f4fb-4657-b40f-04af35e0e159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:56.236512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ad00f-f4fb-4657-b40f-04af35e0e159 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:56.251347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1065/2106] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:56.252522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad00f-f4fb-4657-b40f-04af35e0e159 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:56.253868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:56.255906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-115ad00f-f4fb-4657-b40f-04af35e0e159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:56.293733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6772c334c494db392404e46070c77ef'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:56.319621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6772c334c494db392404e46070c77ef'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:56.322417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6772c334c494db392404e46070c77ef'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:56.350173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6772c334c494db392404e46070c77ef'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:56.402979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad00f-f4fb-4657-b40f-04af35e0e159 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:56.411416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae993be7-3b5d-47eb-aca9-9dc1079c96ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:56.412094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae993be7-3b5d-47eb-aca9-9dc1079c96ad service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:56.412403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae993be7-3b5d-47eb-aca9-9dc1079c96ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:56.412789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae993be7-3b5d-47eb-aca9-9dc1079c96ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:56.420775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ae993be7-3b5d-47eb-aca9-9dc1079c96ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:56.440769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6772c334c494db392404e46070c77ef'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:56.469661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1042/2107] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:33:55 2022] DELETE /identity/v3/users/a6772c334c494db392404e46070c77ef => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:56.470530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:56.473406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:56.547349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae993be7-3b5d-47eb-aca9-9dc1079c96ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:56.548759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae993be7-3b5d-47eb-aca9-9dc1079c96ad service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:56.560330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:56.568537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1066/2108] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:56.671390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9031-74d5-40e5-946e-10b198e6f2a6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:56.683691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e6426-854e-4732-b5ae-3b22671b7534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:56.684877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e6426-854e-4732-b5ae-3b22671b7534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:56.685427 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e6426-854e-4732-b5ae-3b22671b7534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:56.685940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e6426-854e-4732-b5ae-3b22671b7534 admin admin] PATH_INFO: `/v3/projects/2401531c25d6455dbcfc3e81713058a3/users/2dea780db38944c88428554903b3b1af/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:56.714446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e6426-854e-4732-b5ae-3b22671b7534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2401531c25d6455dbcfc3e81713058a3, user_id=2dea780db38944c88428554903b3b1af, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:56.718241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e6426-854e-4732-b5ae-3b22671b7534 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:56.743745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1043/2109] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:56 2022] PUT /identity/v3/projects/2401531c25d6455dbcfc3e81713058a3/users/2dea780db38944c88428554903b3b1af/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:56.748582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b5010-4044-42ff-9877-b32b94750864 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:56.748870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b5010-4044-42ff-9877-b32b94750864 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:56.749182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b5010-4044-42ff-9877-b32b94750864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:56.770000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e37b5010-4044-42ff-9877-b32b94750864 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:56.771217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e37b5010-4044-42ff-9877-b32b94750864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:56.863300 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1067/2110] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:56.876335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e6426-854e-4732-b5ae-3b22671b7534 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:56.878496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c89e6426-854e-4732-b5ae-3b22671b7534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:56.969940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e6426-854e-4732-b5ae-3b22671b7534 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:56.977458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724220a3-b668-4d67-9814-16d15f3bd77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:56.978890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724220a3-b668-4d67-9814-16d15f3bd77b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:56.979443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724220a3-b668-4d67-9814-16d15f3bd77b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:56.979924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724220a3-b668-4d67-9814-16d15f3bd77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:56.992433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724220a3-b668-4d67-9814-16d15f3bd77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:56.994381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724220a3-b668-4d67-9814-16d15f3bd77b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:57.031212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1044/2111] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:33:57.422377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b5010-4044-42ff-9877-b32b94750864 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:57.424070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e37b5010-4044-42ff-9877-b32b94750864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:57.449558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b5010-4044-42ff-9877-b32b94750864 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:57.454525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:57.455278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:57.455681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:57.456057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] PATH_INFO: `/v3/projects/41c83bca6e70494d82723d0504717347` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:57.465722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c83bca6e70494d82723d0504717347)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:57.467802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:57.546075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c83bca6e70494d82723d0504717347', 'request_id': 'req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:57.570462 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c83bca6e70494d82723d0504717347', 'request_id': 'req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:57.584894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c83bca6e70494d82723d0504717347', 'request_id': 'req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:57.619871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] The token cache is being invalidate because project 41c83bca6e70494d82723d0504717347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:33:57.620868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:57.621520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2f10f0a6-453b-4f6b-8c41-a26cadc1cd12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:33:57.624498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1068/2112] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:33:57 2022] DELETE /identity/v3/projects/41c83bca6e70494d82723d0504717347 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:57.629890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357399f-9346-43f4-afe9-88fb2c4e1b9a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:57.630202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357399f-9346-43f4-afe9-88fb2c4e1b9a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:57.630476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357399f-9346-43f4-afe9-88fb2c4e1b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:57.661451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b357399f-9346-43f4-afe9-88fb2c4e1b9a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:57.666690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b357399f-9346-43f4-afe9-88fb2c4e1b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:57.718032 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:57.795096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1045/2113] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:57.802990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff14435-cafa-4422-9cc8-9a6f496965a4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:57.803284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff14435-cafa-4422-9cc8-9a6f496965a4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:57.803567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff14435-cafa-4422-9cc8-9a6f496965a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:57.860901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-dff14435-cafa-4422-9cc8-9a6f496965a4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:57.864271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-dff14435-cafa-4422-9cc8-9a6f496965a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:57.893164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1069/2114] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:57.898490 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357399f-9346-43f4-afe9-88fb2c4e1b9a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:57.919334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357399f-9346-43f4-afe9-88fb2c4e1b9a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:57.933289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b68c7-44c3-47aa-bdbe-e7d6c5274f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:57.936310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b68c7-44c3-47aa-bdbe-e7d6c5274f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:57.936310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b68c7-44c3-47aa-bdbe-e7d6c5274f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:57.937225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b68c7-44c3-47aa-bdbe-e7d6c5274f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:57.937813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b68c7-44c3-47aa-bdbe-e7d6c5274f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:33:57.940429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b68c7-44c3-47aa-bdbe-e7d6c5274f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:57.942878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b68c7-44c3-47aa-bdbe-e7d6c5274f90 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:57.980937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1046/2115] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:33:57.983642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff14435-cafa-4422-9cc8-9a6f496965a4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:58.009038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff14435-cafa-4422-9cc8-9a6f496965a4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:58.041009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390dc0-52ee-4092-90f9-b314d1cd5eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:58.042851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390dc0-52ee-4092-90f9-b314d1cd5eea admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:58.043135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390dc0-52ee-4092-90f9-b314d1cd5eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:58.043410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390dc0-52ee-4092-90f9-b314d1cd5eea admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:58.044060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66390dc0-52ee-4092-90f9-b314d1cd5eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:58.048694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66390dc0-52ee-4092-90f9-b314d1cd5eea admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:58.117844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1070/2116] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:33:57 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:33:58.120354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b68c7-44c3-47aa-bdbe-e7d6c5274f90 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:58.135648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b68c7-44c3-47aa-bdbe-e7d6c5274f90 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:58.247193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d8f7e-5472-47aa-b58d-26d35231545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:58.248156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d8f7e-5472-47aa-b58d-26d35231545b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:58.248447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d8f7e-5472-47aa-b58d-26d35231545b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:58.248726 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d8f7e-5472-47aa-b58d-26d35231545b admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:58.253637 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d8f7e-5472-47aa-b58d-26d35231545b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:58.255707 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d8f7e-5472-47aa-b58d-26d35231545b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:58.354016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390dc0-52ee-4092-90f9-b314d1cd5eea admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:58.361009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1047/2117] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:33:58 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:33:58.374649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390dc0-52ee-4092-90f9-b314d1cd5eea admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:58.387888 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6cd1b-98fb-4782-a74c-2fdff5701ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:58.388675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6cd1b-98fb-4782-a74c-2fdff5701ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:58.388901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6cd1b-98fb-4782-a74c-2fdff5701ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:58.389272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6cd1b-98fb-4782-a74c-2fdff5701ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:58.390152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6cd1b-98fb-4782-a74c-2fdff5701ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:58.395060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6cd1b-98fb-4782-a74c-2fdff5701ea0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:58.426762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d8f7e-5472-47aa-b58d-26d35231545b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:58.428822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1071/2118] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:58.446900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d8f7e-5472-47aa-b58d-26d35231545b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:58.482148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab3431-435c-434d-9637-ad3282a2de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:58.482788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3431-435c-434d-9637-ad3282a2de03 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:58.483074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3431-435c-434d-9637-ad3282a2de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:58.483351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3431-435c-434d-9637-ad3282a2de03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:58.484013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab3431-435c-434d-9637-ad3282a2de03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:58.486247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab3431-435c-434d-9637-ad3282a2de03 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:58.529005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1048/2119] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:33:58.533223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6cd1b-98fb-4782-a74c-2fdff5701ea0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:58.558211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6cd1b-98fb-4782-a74c-2fdff5701ea0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:58.612765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2c41e-a4a1-4e3b-a61b-fe837b54a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:58.613947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c41e-a4a1-4e3b-a61b-fe837b54a911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:58.614438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c41e-a4a1-4e3b-a61b-fe837b54a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:58.614721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2c41e-a4a1-4e3b-a61b-fe837b54a911 admin admin] PATH_INFO: `/v3/projects/53e5a9e9fe954268af10611296535d1b/users/2b72852a48094d8e891a6365004d5183/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:58.684850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2c41e-a4a1-4e3b-a61b-fe837b54a911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e5a9e9fe954268af10611296535d1b, user_id=2b72852a48094d8e891a6365004d5183, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:58.696553 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2c41e-a4a1-4e3b-a61b-fe837b54a911 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:58.741008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1072/2120] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:33:58 2022] PUT /identity/v3/projects/53e5a9e9fe954268af10611296535d1b/users/2b72852a48094d8e891a6365004d5183/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:33:58.745114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ce4d-3606-4c2b-a461-e0ecbdfcd4ca None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:58.745408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ce4d-3606-4c2b-a461-e0ecbdfcd4ca None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:58.745690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ce4d-3606-4c2b-a461-e0ecbdfcd4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:58.785964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1446ce4d-3606-4c2b-a461-e0ecbdfcd4ca None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:33:58.787256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1446ce4d-3606-4c2b-a461-e0ecbdfcd4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:58.912708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1049/2121] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:33:58.953772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2c41e-a4a1-4e3b-a61b-fe837b54a911 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:33:58.955577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-59e2c41e-a4a1-4e3b-a61b-fe837b54a911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:33:58.999241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:59.083944 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2c41e-a4a1-4e3b-a61b-fe837b54a911 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:33:59.095464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fb6a2-79a4-4415-9917-8ddcb5c924ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:33:59.096417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb6a2-79a4-4415-9917-8ddcb5c924ea service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:33:59.096880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb6a2-79a4-4415-9917-8ddcb5c924ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:33:59.097324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb6a2-79a4-4415-9917-8ddcb5c924ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:33:59.121717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fb6a2-79a4-4415-9917-8ddcb5c924ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:33:59.123535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fb6a2-79a4-4415-9917-8ddcb5c924ea service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:33:59.139501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1073/2122] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:34:00.291507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367a40a-d268-4fd8-97cf-7525036a0209 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:00.291962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367a40a-d268-4fd8-97cf-7525036a0209 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:00.292051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367a40a-d268-4fd8-97cf-7525036a0209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:00.338061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3367a40a-d268-4fd8-97cf-7525036a0209 None None] MFA Rules not processed for user `2b72852a48094d8e891a6365004d5183`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:00.339492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3367a40a-d268-4fd8-97cf-7525036a0209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:00.373788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:00.442304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1050/2123] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:00.442504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fb6a2-79a4-4415-9917-8ddcb5c924ea service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:00.457648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fb6a2-79a4-4415-9917-8ddcb5c924ea service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:00.466036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b6140-550c-4278-90ae-14034ad6818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:00.467504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6140-550c-4278-90ae-14034ad6818a admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:00.468241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6140-550c-4278-90ae-14034ad6818a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:00.468769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6140-550c-4278-90ae-14034ad6818a admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:00.469807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b6140-550c-4278-90ae-14034ad6818a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:00.472249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b6140-550c-4278-90ae-14034ad6818a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:00.517471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1074/2124] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:34:00 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:34:00.521326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367a40a-d268-4fd8-97cf-7525036a0209 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:00.543815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367a40a-d268-4fd8-97cf-7525036a0209 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:00.639324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ac0d9-ecca-4f83-8efa-f0251badd835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:00.640367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ac0d9-ecca-4f83-8efa-f0251badd835 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:00.640367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ac0d9-ecca-4f83-8efa-f0251badd835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:00.640831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ac0d9-ecca-4f83-8efa-f0251badd835 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:00.641803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ac0d9-ecca-4f83-8efa-f0251badd835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:00.646785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ac0d9-ecca-4f83-8efa-f0251badd835 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:00.682136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1051/2125] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:34:00 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:34:00.684791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b6140-550c-4278-90ae-14034ad6818a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:00.701177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b6140-550c-4278-90ae-14034ad6818a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:00.708244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4e783-eca6-4336-8d99-52aaf4249343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:00.709326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4e783-eca6-4336-8d99-52aaf4249343 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:00.709833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4e783-eca6-4336-8d99-52aaf4249343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:00.710411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4e783-eca6-4336-8d99-52aaf4249343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:00.711662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4e783-eca6-4336-8d99-52aaf4249343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:00.714407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4e783-eca6-4336-8d99-52aaf4249343 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:00.736003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1075/2126] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:34:00.745056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ac0d9-ecca-4f83-8efa-f0251badd835 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:00.764724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ac0d9-ecca-4f83-8efa-f0251badd835 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:00.778453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfa414-6b3d-4429-a164-fe27764dc607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:00.779363 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfa414-6b3d-4429-a164-fe27764dc607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:00.783156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfa414-6b3d-4429-a164-fe27764dc607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:00.783446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfa414-6b3d-4429-a164-fe27764dc607 admin admin] PATH_INFO: `/v3/projects/c4de6cd60bfd43619146c5af2431c4e4/users/485d8d2bb5af491c896c964b90d4c911/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:00.823465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfa414-6b3d-4429-a164-fe27764dc607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4de6cd60bfd43619146c5af2431c4e4, user_id=485d8d2bb5af491c896c964b90d4c911, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:00.827696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfa414-6b3d-4429-a164-fe27764dc607 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:00.849144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1052/2127] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:34:00 2022] PUT /identity/v3/projects/c4de6cd60bfd43619146c5af2431c4e4/users/485d8d2bb5af491c896c964b90d4c911/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:00.853398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4e783-eca6-4336-8d99-52aaf4249343 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:00.864879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4e783-eca6-4336-8d99-52aaf4249343 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:00.977764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac92f-c78e-4c62-8d80-a9e588cdfbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:00.978669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac92f-c78e-4c62-8d80-a9e588cdfbde admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:00.979343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac92f-c78e-4c62-8d80-a9e588cdfbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:00.979783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac92f-c78e-4c62-8d80-a9e588cdfbde admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:00.980588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ac92f-c78e-4c62-8d80-a9e588cdfbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:00.982635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ac92f-c78e-4c62-8d80-a9e588cdfbde admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:01.003436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1076/2128] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:34:01.010646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfa414-6b3d-4429-a164-fe27764dc607 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:01.035461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfa414-6b3d-4429-a164-fe27764dc607 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:01.048389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec240245-fb9a-4761-907a-4ed7ddbec412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:01.050620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec240245-fb9a-4761-907a-4ed7ddbec412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:01.051669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec240245-fb9a-4761-907a-4ed7ddbec412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:01.052009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec240245-fb9a-4761-907a-4ed7ddbec412 admin admin] PATH_INFO: `/v3/projects/c4de6cd60bfd43619146c5af2431c4e4/users/485d8d2bb5af491c896c964b90d4c911/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:01.058546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec240245-fb9a-4761-907a-4ed7ddbec412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4de6cd60bfd43619146c5af2431c4e4, user_id=485d8d2bb5af491c896c964b90d4c911, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:01.068562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec240245-fb9a-4761-907a-4ed7ddbec412 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:01.121324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1053/2129] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:34:01 2022] PUT /identity/v3/projects/c4de6cd60bfd43619146c5af2431c4e4/users/485d8d2bb5af491c896c964b90d4c911/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:01.367625 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac92f-c78e-4c62-8d80-a9e588cdfbde admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:01.369517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-005ac92f-c78e-4c62-8d80-a9e588cdfbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:01.388056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac92f-c78e-4c62-8d80-a9e588cdfbde admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:01.470804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:01.471778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:01.472072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:01.472696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] PATH_INFO: `/v3/users/1a4437b4a0a6402c9cd0c78087b86b51` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:01.473820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a4437b4a0a6402c9cd0c78087b86b51)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:01.477282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:01.512923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:01.542035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a4437b4a0a6402c9cd0c78087b86b51'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:01.542720 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a4437b4a0a6402c9cd0c78087b86b51'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:01.576988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a4437b4a0a6402c9cd0c78087b86b51'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:01.605651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a4437b4a0a6402c9cd0c78087b86b51'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:01.606550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a4437b4a0a6402c9cd0c78087b86b51'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:01.640374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1077/2130] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:34:01 2022] DELETE /identity/v3/users/1a4437b4a0a6402c9cd0c78087b86b51 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:01.645388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7d25-ad10-467c-b97d-2f81c6c964bc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:01.648312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7d25-ad10-467c-b97d-2f81c6c964bc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:01.648826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7d25-ad10-467c-b97d-2f81c6c964bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:01.691544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5bee7d25-ad10-467c-b97d-2f81c6c964bc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:01.692846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5bee7d25-ad10-467c-b97d-2f81c6c964bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:01.772093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1054/2131] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:01.796535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:01.800918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:01.895210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60153cd3-2f71-4a19-b986-d830986d6b28 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:01.900772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de5fa3-64db-49f6-a704-58425f3c38fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:01.902496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5fa3-64db-49f6-a704-58425f3c38fe service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:01.902864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5fa3-64db-49f6-a704-58425f3c38fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:01.903212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5fa3-64db-49f6-a704-58425f3c38fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:01.914421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de5fa3-64db-49f6-a704-58425f3c38fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:01.915880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de5fa3-64db-49f6-a704-58425f3c38fe service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:01.928067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1078/2132] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:34:02.966316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee7d25-ad10-467c-b97d-2f81c6c964bc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:02.967936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5bee7d25-ad10-467c-b97d-2f81c6c964bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:02.990979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee7d25-ad10-467c-b97d-2f81c6c964bc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:03.002294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:03.004326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:03.005122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:03.005848 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] PATH_INFO: `/v3/projects/62f5301e5e1b488588e60531a455fa93` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:03.009278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f5301e5e1b488588e60531a455fa93)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:03.013589 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:03.037338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:03.067045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1402807-ef1a-4c8c-a659-49d0123210a1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:03.067626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1402807-ef1a-4c8c-a659-49d0123210a1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:03.067626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1402807-ef1a-4c8c-a659-49d0123210a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:03.130685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d1402807-ef1a-4c8c-a659-49d0123210a1 None None] MFA Rules not processed for user `485d8d2bb5af491c896c964b90d4c911`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:03.136917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d1402807-ef1a-4c8c-a659-49d0123210a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:03.142797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f5301e5e1b488588e60531a455fa93', 'request_id': 'req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:03.153789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f5301e5e1b488588e60531a455fa93', 'request_id': 'req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:03.176350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f5301e5e1b488588e60531a455fa93', 'request_id': 'req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:03.195601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] The token cache is being invalidate because project 62f5301e5e1b488588e60531a455fa93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:34:03.195892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:03.196982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:03.199011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1055/2133] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:34:02 2022] DELETE /identity/v3/projects/62f5301e5e1b488588e60531a455fa93 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:03.204280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:03.206114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:03.315792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1079/2134] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:34:03.317813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ef498-58ad-4ed7-a297-4752bc64b170 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:03.318325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ef498-58ad-4ed7-a297-4752bc64b170 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:03.318802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ef498-58ad-4ed7-a297-4752bc64b170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:03.375773 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-fe0ef498-58ad-4ed7-a297-4752bc64b170 None None] MFA Rules not processed for user `2b72852a48094d8e891a6365004d5183`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:03.377253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fe0ef498-58ad-4ed7-a297-4752bc64b170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:03.401851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb33b9-5a4e-4ff8-af92-ad20861f2bde admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:03.416571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:03.417214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:03.417602 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:03.418112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] PATH_INFO: `/v3/users/a274737fb07e4882a8c2c91af84d7feb` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:03.419771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a274737fb07e4882a8c2c91af84d7feb)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:03.421856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:03.461003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:03.518998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a274737fb07e4882a8c2c91af84d7feb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:03.536583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1080/2135] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:03.537743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a274737fb07e4882a8c2c91af84d7feb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:03.539269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a274737fb07e4882a8c2c91af84d7feb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:03.551931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a274737fb07e4882a8c2c91af84d7feb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:03.583282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a274737fb07e4882a8c2c91af84d7feb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:03.597046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1056/2136] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:34:03 2022] DELETE /identity/v3/users/a274737fb07e4882a8c2c91af84d7feb => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:03.906035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ef498-58ad-4ed7-a297-4752bc64b170 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:03.907634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fe0ef498-58ad-4ed7-a297-4752bc64b170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:04.106772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ef498-58ad-4ed7-a297-4752bc64b170 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:04.240463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae020c87-548a-4837-a0b6-3cf0d3b375bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:04.242054 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020c87-548a-4837-a0b6-3cf0d3b375bc service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:04.242054 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020c87-548a-4837-a0b6-3cf0d3b375bc service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:04.242890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020c87-548a-4837-a0b6-3cf0d3b375bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:04.245196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ae020c87-548a-4837-a0b6-3cf0d3b375bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:04.399142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae020c87-548a-4837-a0b6-3cf0d3b375bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:04.400438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae020c87-548a-4837-a0b6-3cf0d3b375bc service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:04.418013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1081/2137] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:34:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:34:04.681724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:04.683266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:04.712498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:04.780792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f73fad-0496-46a8-ac3c-1f008a70eed7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:04.786812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:04.787665 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:04.789446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:04.790056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] PATH_INFO: `/v3/projects/bbf0dae60dc1476ea5fbb9ce90f07832` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:04.791545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf0dae60dc1476ea5fbb9ce90f07832)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:04.793705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:04.870875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf0dae60dc1476ea5fbb9ce90f07832', 'request_id': 'req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:04.885120 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf0dae60dc1476ea5fbb9ce90f07832', 'request_id': 'req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:04.911651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf0dae60dc1476ea5fbb9ce90f07832', 'request_id': 'req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:04.932580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] The token cache is being invalidate because project bbf0dae60dc1476ea5fbb9ce90f07832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:34:04.932890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:04.933962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b2a15eac-2087-46ea-81a9-f9e9eeb2554e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:04.936492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1057/2138] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:34:04 2022] DELETE /identity/v3/projects/bbf0dae60dc1476ea5fbb9ce90f07832 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:04.940181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae020c87-548a-4837-a0b6-3cf0d3b375bc service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:04.962502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae020c87-548a-4837-a0b6-3cf0d3b375bc service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:04.972437 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:05.040847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:05.041736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:05.042127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:05.042517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] PATH_INFO: `/v3/users/1915e9f972b24d3faba0696856cc663d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:05.045035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1915e9f972b24d3faba0696856cc663d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:05.047814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:05.180330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1915e9f972b24d3faba0696856cc663d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:05.181754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1915e9f972b24d3faba0696856cc663d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:05.200575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1915e9f972b24d3faba0696856cc663d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:05.221659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1915e9f972b24d3faba0696856cc663d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:05.222677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1915e9f972b24d3faba0696856cc663d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:05.252598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1082/2139] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:34:04 2022] DELETE /identity/v3/users/1915e9f972b24d3faba0696856cc663d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:05.816933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ebeb9-f2c1-4c9b-adf8-3c090e5d006b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:05.817457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ebeb9-f2c1-4c9b-adf8-3c090e5d006b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:05.817549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ebeb9-f2c1-4c9b-adf8-3c090e5d006b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:05.859717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3c0ebeb9-f2c1-4c9b-adf8-3c090e5d006b None None] MFA Rules not processed for user `2dea780db38944c88428554903b3b1af`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:05.861170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3c0ebeb9-f2c1-4c9b-adf8-3c090e5d006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:05.947472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1058/2140] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:05.951593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:05.953747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:06.105757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd23eb4-448c-40d2-9618-39e5ef79a7c3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:06.117074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699876c-fefa-4fc7-93a8-cb6827e99552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:06.118183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699876c-fefa-4fc7-93a8-cb6827e99552 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.120226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699876c-fefa-4fc7-93a8-cb6827e99552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.120899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699876c-fefa-4fc7-93a8-cb6827e99552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.122424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699876c-fefa-4fc7-93a8-cb6827e99552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:06.126743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699876c-fefa-4fc7-93a8-cb6827e99552 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:06.176222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ebeb9-f2c1-4c9b-adf8-3c090e5d006b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:06.176584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1083/2141] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:34:05 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:34:06.200860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ebeb9-f2c1-4c9b-adf8-3c090e5d006b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:06.254768 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:06.296040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4e88-d056-4ee2-8b5a-3edf937ac8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:06.297459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4e88-d056-4ee2-8b5a-3edf937ac8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.297749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4e88-d056-4ee2-8b5a-3edf937ac8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.298665 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4e88-d056-4ee2-8b5a-3edf937ac8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.299583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4e88-d056-4ee2-8b5a-3edf937ac8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:06.301635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4e88-d056-4ee2-8b5a-3edf937ac8d4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:06.352884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1059/2142] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:34:06 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:34:06.355215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699876c-fefa-4fc7-93a8-cb6827e99552 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:06.387042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699876c-fefa-4fc7-93a8-cb6827e99552 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:06.400777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a7366-eeba-41a0-b8ff-e78a41ba911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:06.402467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7366-eeba-41a0-b8ff-e78a41ba911e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.404408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4e88-d056-4ee2-8b5a-3edf937ac8d4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:06.406891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-03ca4e88-d056-4ee2-8b5a-3edf937ac8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:06.441179 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7366-eeba-41a0-b8ff-e78a41ba911e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.442380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7366-eeba-41a0-b8ff-e78a41ba911e admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.453415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a7366-eeba-41a0-b8ff-e78a41ba911e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:06.459151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a7366-eeba-41a0-b8ff-e78a41ba911e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:06.466356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4e88-d056-4ee2-8b5a-3edf937ac8d4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:06.471856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:06.472555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.472862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.473151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] PATH_INFO: `/v3/projects/8f13273794994d14b6b0af579c13c2a6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.474776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f13273794994d14b6b0af579c13c2a6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:06.476840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:06.485440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1084/2143] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:34:06.490299 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a7366-eeba-41a0-b8ff-e78a41ba911e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:06.504639 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a7366-eeba-41a0-b8ff-e78a41ba911e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:06.511009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27010ad7-81d2-4613-af71-18eeaa178d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:06.512002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27010ad7-81d2-4613-af71-18eeaa178d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.512610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27010ad7-81d2-4613-af71-18eeaa178d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.513071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27010ad7-81d2-4613-af71-18eeaa178d1b admin admin] PATH_INFO: `/v3/projects/508a9b9b69e242289939b59e784322b3/users/4f15801b4537460cb0bcb6c4984d4bc7/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.516076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:06.536455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27010ad7-81d2-4613-af71-18eeaa178d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=508a9b9b69e242289939b59e784322b3, user_id=4f15801b4537460cb0bcb6c4984d4bc7, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:06.537235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f13273794994d14b6b0af579c13c2a6', 'request_id': 'req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:06.540734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27010ad7-81d2-4613-af71-18eeaa178d1b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:06.569583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1085/2144] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:34:06 2022] PUT /identity/v3/projects/508a9b9b69e242289939b59e784322b3/users/4f15801b4537460cb0bcb6c4984d4bc7/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:34:06.572059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27010ad7-81d2-4613-af71-18eeaa178d1b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:06.572399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f13273794994d14b6b0af579c13c2a6', 'request_id': 'req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:06.582086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f13273794994d14b6b0af579c13c2a6', 'request_id': 'req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:06.601845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] The token cache is being invalidate because project 8f13273794994d14b6b0af579c13c2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:34:06.602150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:06.603094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6669cbe3-5239-4db6-8eb8-ca26be0f5ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:06.608837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1060/2145] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:34:06 2022] DELETE /identity/v3/projects/8f13273794994d14b6b0af579c13c2a6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:34:06.611932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86cfef-b1d0-4265-a26d-e081945b4610 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.612232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86cfef-b1d0-4265-a26d-e081945b4610 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.613633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86cfef-b1d0-4265-a26d-e081945b4610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.648440 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5e86cfef-b1d0-4265-a26d-e081945b4610 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:06.649543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5e86cfef-b1d0-4265-a26d-e081945b4610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:06.678469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27010ad7-81d2-4613-af71-18eeaa178d1b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:06.686969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c7e19-ed8c-4bc1-95d4-663dbd45e16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:06.687595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c7e19-ed8c-4bc1-95d4-663dbd45e16e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.687875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c7e19-ed8c-4bc1-95d4-663dbd45e16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.688147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c7e19-ed8c-4bc1-95d4-663dbd45e16e admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.688794 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c7e19-ed8c-4bc1-95d4-663dbd45e16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:06.690825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c7e19-ed8c-4bc1-95d4-663dbd45e16e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:06.711045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1086/2146] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:34:06.712158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c7e19-ed8c-4bc1-95d4-663dbd45e16e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:06.713952 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-aa2c7e19-ed8c-4bc1-95d4-663dbd45e16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:06.731361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c7e19-ed8c-4bc1-95d4-663dbd45e16e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:06.736892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed1302-696b-4183-9dca-544c1ef7e632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:06.738409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed1302-696b-4183-9dca-544c1ef7e632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.738913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed1302-696b-4183-9dca-544c1ef7e632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.739278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed1302-696b-4183-9dca-544c1ef7e632 admin admin] PATH_INFO: `/v3/projects/508a9b9b69e242289939b59e784322b3/users/4f15801b4537460cb0bcb6c4984d4bc7/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.743250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed1302-696b-4183-9dca-544c1ef7e632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508a9b9b69e242289939b59e784322b3, user_id=4f15801b4537460cb0bcb6c4984d4bc7, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:06.747726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed1302-696b-4183-9dca-544c1ef7e632 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:06.769428 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1087/2147] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:34:06 2022] PUT /identity/v3/projects/508a9b9b69e242289939b59e784322b3/users/4f15801b4537460cb0bcb6c4984d4bc7/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:06.788095 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1061/2148] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:06.794217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3c22-80d7-47a7-94ce-3ac8e328c75e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.794702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3c22-80d7-47a7-94ce-3ac8e328c75e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.795076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3c22-80d7-47a7-94ce-3ac8e328c75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.820489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4cbd3c22-80d7-47a7-94ce-3ac8e328c75e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:06.822125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4cbd3c22-80d7-47a7-94ce-3ac8e328c75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:06.918761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1088/2149] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:06.919635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86cfef-b1d0-4265-a26d-e081945b4610 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:06.930600 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86cfef-b1d0-4265-a26d-e081945b4610 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:06.936117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249551fe-0ab9-4d35-9af6-02f62678b3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:06.936740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249551fe-0ab9-4d35-9af6-02f62678b3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.937053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249551fe-0ab9-4d35-9af6-02f62678b3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.937332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249551fe-0ab9-4d35-9af6-02f62678b3f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.938017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249551fe-0ab9-4d35-9af6-02f62678b3f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:34:06.938591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249551fe-0ab9-4d35-9af6-02f62678b3f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:06.940453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249551fe-0ab9-4d35-9af6-02f62678b3f8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:06.953020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1062/2150] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:34:06.957485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd3c22-80d7-47a7-94ce-3ac8e328c75e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:06.975264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd3c22-80d7-47a7-94ce-3ac8e328c75e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:06.984612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811eca5-e3d0-4847-b04f-6f4c8c1c03d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:06.985291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811eca5-e3d0-4847-b04f-6f4c8c1c03d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:06.985584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811eca5-e3d0-4847-b04f-6f4c8c1c03d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:06.985873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811eca5-e3d0-4847-b04f-6f4c8c1c03d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:06.986518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811eca5-e3d0-4847-b04f-6f4c8c1c03d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:06.988620 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811eca5-e3d0-4847-b04f-6f4c8c1c03d2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:07.030405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1089/2151] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:34:06 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:34:07.031977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249551fe-0ab9-4d35-9af6-02f62678b3f8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:07.046890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249551fe-0ab9-4d35-9af6-02f62678b3f8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:07.100742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:07.123817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c461d-4acd-4d94-9da4-c95d50b8e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:07.124355 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c461d-4acd-4d94-9da4-c95d50b8e200 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:07.124639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c461d-4acd-4d94-9da4-c95d50b8e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:07.124913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c461d-4acd-4d94-9da4-c95d50b8e200 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:07.125587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c461d-4acd-4d94-9da4-c95d50b8e200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:07.127525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c461d-4acd-4d94-9da4-c95d50b8e200 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:07.157368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1063/2152] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:34:07 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:34:07.165751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811eca5-e3d0-4847-b04f-6f4c8c1c03d2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:07.179938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811eca5-e3d0-4847-b04f-6f4c8c1c03d2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:07.186150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273fb1a-b8c4-4641-9b30-f5dad2f0e7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:07.186943 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273fb1a-b8c4-4641-9b30-f5dad2f0e7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:07.187315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273fb1a-b8c4-4641-9b30-f5dad2f0e7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:07.187824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273fb1a-b8c4-4641-9b30-f5dad2f0e7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:07.188606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273fb1a-b8c4-4641-9b30-f5dad2f0e7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:07.190337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273fb1a-b8c4-4641-9b30-f5dad2f0e7f7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:07.207127 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1090/2153] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:34:07.209117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c461d-4acd-4d94-9da4-c95d50b8e200 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:07.221979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c461d-4acd-4d94-9da4-c95d50b8e200 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:07.236697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6216e2-67fb-42b5-9e0b-0fac1d5324a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:07.237458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6216e2-67fb-42b5-9e0b-0fac1d5324a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:07.237857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6216e2-67fb-42b5-9e0b-0fac1d5324a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:07.238197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6216e2-67fb-42b5-9e0b-0fac1d5324a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:07.238923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6216e2-67fb-42b5-9e0b-0fac1d5324a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:07.240921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6216e2-67fb-42b5-9e0b-0fac1d5324a5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:07.255122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1064/2154] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:34:07.262662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273fb1a-b8c4-4641-9b30-f5dad2f0e7f7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:07.276406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273fb1a-b8c4-4641-9b30-f5dad2f0e7f7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:07.283374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a442e1-323d-4e7c-9d05-bda1a256d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:07.284377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a442e1-323d-4e7c-9d05-bda1a256d53e admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:07.284878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a442e1-323d-4e7c-9d05-bda1a256d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:07.285504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a442e1-323d-4e7c-9d05-bda1a256d53e admin admin] PATH_INFO: `/v3/projects/7b28676620044f4d9e0a547ffc9d7c7c/users/12bcee6ce3454d57824459e47b4b4ccf/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:07.315125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a442e1-323d-4e7c-9d05-bda1a256d53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b28676620044f4d9e0a547ffc9d7c7c, user_id=12bcee6ce3454d57824459e47b4b4ccf, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:07.318390 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a442e1-323d-4e7c-9d05-bda1a256d53e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:07.375042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1091/2155] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:34:07 2022] PUT /identity/v3/projects/7b28676620044f4d9e0a547ffc9d7c7c/users/12bcee6ce3454d57824459e47b4b4ccf/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:07.376698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf96a-20dd-489a-8423-fc603fb68af3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:07.376930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf96a-20dd-489a-8423-fc603fb68af3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:07.377297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf96a-20dd-489a-8423-fc603fb68af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:07.428328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ab6bf96a-20dd-489a-8423-fc603fb68af3 None None] MFA Rules not processed for user `12bcee6ce3454d57824459e47b4b4ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:07.430443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ab6bf96a-20dd-489a-8423-fc603fb68af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:07.553480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1065/2156] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:07.574258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a442e1-323d-4e7c-9d05-bda1a256d53e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:07.576700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-54a442e1-323d-4e7c-9d05-bda1a256d53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:07.599858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:07.677372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a442e1-323d-4e7c-9d05-bda1a256d53e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:07.684205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80121-e27c-4c21-b8bd-4749539abd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:07.685533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80121-e27c-4c21-b8bd-4749539abd4a service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:07.685891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80121-e27c-4c21-b8bd-4749539abd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:07.686346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80121-e27c-4c21-b8bd-4749539abd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:07.700027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f80121-e27c-4c21-b8bd-4749539abd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:07.701596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f80121-e27c-4c21-b8bd-4749539abd4a service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:07.724221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1092/2157] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:34:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:34:09.388529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052ba7b-8283-468d-a76b-df4fe808ec71 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:09.389379 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052ba7b-8283-468d-a76b-df4fe808ec71 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:09.389792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052ba7b-8283-468d-a76b-df4fe808ec71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:09.414761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4052ba7b-8283-468d-a76b-df4fe808ec71 None None] MFA Rules not processed for user `12bcee6ce3454d57824459e47b4b4ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:09.416648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4052ba7b-8283-468d-a76b-df4fe808ec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:09.431450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1066/2158] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:13.281746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80121-e27c-4c21-b8bd-4749539abd4a service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:13.284020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-91f80121-e27c-4c21-b8bd-4749539abd4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:13.405509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80121-e27c-4c21-b8bd-4749539abd4a service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:13.412288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:13.413085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:13.413420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:13.413945 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] PATH_INFO: `/v3/users/8361c48f79a7419688d3f6b7289953e7` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:13.416322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8361c48f79a7419688d3f6b7289953e7)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:13.418803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:13.501509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8361c48f79a7419688d3f6b7289953e7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:13.501857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8361c48f79a7419688d3f6b7289953e7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:13.518867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8361c48f79a7419688d3f6b7289953e7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:13.550909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8361c48f79a7419688d3f6b7289953e7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:13.551771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-3cc9c094-91aa-42b5-b27b-d9c5b9a6d50a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8361c48f79a7419688d3f6b7289953e7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:13.608021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1093/2159] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:34:13 2022] DELETE /identity/v3/users/8361c48f79a7419688d3f6b7289953e7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:13.850556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052ba7b-8283-468d-a76b-df4fe808ec71 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:13.872051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052ba7b-8283-468d-a76b-df4fe808ec71 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:13.962806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:13.963455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:13.964393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:13.964686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] PATH_INFO: `/v3/projects/67fe0b8641f6465e89a52533ed91ae4b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:13.965950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fe0b8641f6465e89a52533ed91ae4b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:13.968755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:14.026053 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:14.029118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fe0b8641f6465e89a52533ed91ae4b', 'request_id': 'req-07554f97-08ae-4478-8c01-d7bd06f6b9cb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:14.037360 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fe0b8641f6465e89a52533ed91ae4b', 'request_id': 'req-07554f97-08ae-4478-8c01-d7bd06f6b9cb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:14.048138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fe0b8641f6465e89a52533ed91ae4b', 'request_id': 'req-07554f97-08ae-4478-8c01-d7bd06f6b9cb'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:14.070712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] The token cache is being invalidate because project 67fe0b8641f6465e89a52533ed91ae4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:34:14.071023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:14.071750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-07554f97-08ae-4478-8c01-d7bd06f6b9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:34:14.074257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1067/2160] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:34:13 2022] DELETE /identity/v3/projects/67fe0b8641f6465e89a52533ed91ae4b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:34:14.080208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92116-2922-4322-a987-a7101a0801db None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:14.080850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92116-2922-4322-a987-a7101a0801db None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:14.081379 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92116-2922-4322-a987-a7101a0801db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:14.103772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d5e92116-2922-4322-a987-a7101a0801db None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:14.105201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d5e92116-2922-4322-a987-a7101a0801db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:14.139903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:14.182140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1094/2161] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:14.188977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201ec3d-7b4a-4bc9-a465-5a4324f6c6ba None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:14.189381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201ec3d-7b4a-4bc9-a465-5a4324f6c6ba None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:14.189762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201ec3d-7b4a-4bc9-a465-5a4324f6c6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:14.224068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8201ec3d-7b4a-4bc9-a465-5a4324f6c6ba None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:14.227613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8201ec3d-7b4a-4bc9-a465-5a4324f6c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:14.244624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1068/2162] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:14.245417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92116-2922-4322-a987-a7101a0801db None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:14.256533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92116-2922-4322-a987-a7101a0801db None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:14.261857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7ff03-fa8e-48e5-9511-0d5894e15d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:14.262403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7ff03-fa8e-48e5-9511-0d5894e15d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:14.262778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7ff03-fa8e-48e5-9511-0d5894e15d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:14.263171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7ff03-fa8e-48e5-9511-0d5894e15d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:14.263932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7ff03-fa8e-48e5-9511-0d5894e15d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:34:14.264344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7ff03-fa8e-48e5-9511-0d5894e15d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:14.266211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7ff03-fa8e-48e5-9511-0d5894e15d5f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:14.282898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1095/2163] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:34:14.284638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201ec3d-7b4a-4bc9-a465-5a4324f6c6ba None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:14.295874 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201ec3d-7b4a-4bc9-a465-5a4324f6c6ba None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:14.306494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c5025-a60c-43ab-af0c-c1267ade39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:14.306494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c5025-a60c-43ab-af0c-c1267ade39ea admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:14.306494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c5025-a60c-43ab-af0c-c1267ade39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:14.307058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c5025-a60c-43ab-af0c-c1267ade39ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:14.307865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c5025-a60c-43ab-af0c-c1267ade39ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:14.310269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c5025-a60c-43ab-af0c-c1267ade39ea admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:14.348209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1069/2164] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:34:14 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:34:14.352705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7ff03-fa8e-48e5-9511-0d5894e15d5f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:14.364841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7ff03-fa8e-48e5-9511-0d5894e15d5f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:14.441170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2274d-04e5-4695-8836-865ca0313700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:14.442043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2274d-04e5-4695-8836-865ca0313700 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:14.442464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2274d-04e5-4695-8836-865ca0313700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:14.442843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2274d-04e5-4695-8836-865ca0313700 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:14.443685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2274d-04e5-4695-8836-865ca0313700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:14.446212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2274d-04e5-4695-8836-865ca0313700 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:14.473723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1096/2165] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:34:14 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:34:14.478270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c5025-a60c-43ab-af0c-c1267ade39ea admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:14.491227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c5025-a60c-43ab-af0c-c1267ade39ea admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:14.500894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127dcdd-27b3-4d64-b126-fe7ab277a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:14.502391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127dcdd-27b3-4d64-b126-fe7ab277a8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:14.502933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127dcdd-27b3-4d64-b126-fe7ab277a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:14.503621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127dcdd-27b3-4d64-b126-fe7ab277a8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:14.504531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127dcdd-27b3-4d64-b126-fe7ab277a8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:14.506648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127dcdd-27b3-4d64-b126-fe7ab277a8a2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:14.519756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1070/2166] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:34:14.523689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2274d-04e5-4695-8836-865ca0313700 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:14.541457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2274d-04e5-4695-8836-865ca0313700 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:14.549674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005da14-aa2e-4769-b4a0-aae651e93ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:14.550296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005da14-aa2e-4769-b4a0-aae651e93ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:14.550579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005da14-aa2e-4769-b4a0-aae651e93ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:14.551064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005da14-aa2e-4769-b4a0-aae651e93ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:14.551703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005da14-aa2e-4769-b4a0-aae651e93ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:14.553162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005da14-aa2e-4769-b4a0-aae651e93ef6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:14.564705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1097/2167] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:34:14.568985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127dcdd-27b3-4d64-b126-fe7ab277a8a2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:14.579950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127dcdd-27b3-4d64-b126-fe7ab277a8a2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:14.586743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9539af-8c30-4402-82e6-033069c012a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:14.587409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9539af-8c30-4402-82e6-033069c012a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:14.587691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9539af-8c30-4402-82e6-033069c012a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:14.588601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9539af-8c30-4402-82e6-033069c012a3 admin admin] PATH_INFO: `/v3/projects/f34a990da86941db80b177b5c91be377/users/79deff91d5c046c4bbe7b2e47b21ba66/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:14.604217 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9539af-8c30-4402-82e6-033069c012a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34a990da86941db80b177b5c91be377, user_id=79deff91d5c046c4bbe7b2e47b21ba66, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:14.607186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9539af-8c30-4402-82e6-033069c012a3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:14.624285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1071/2168] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:34:14 2022] PUT /identity/v3/projects/f34a990da86941db80b177b5c91be377/users/79deff91d5c046c4bbe7b2e47b21ba66/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:34:14.629785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e3e68-890d-4cfb-a2c0-0542db497d82 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:14.630076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e3e68-890d-4cfb-a2c0-0542db497d82 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:14.630362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e3e68-890d-4cfb-a2c0-0542db497d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:14.651084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-858e3e68-890d-4cfb-a2c0-0542db497d82 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:14.653543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-858e3e68-890d-4cfb-a2c0-0542db497d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:14.727318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1098/2169] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:14.735360 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9539af-8c30-4402-82e6-033069c012a3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:14.737443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fc9539af-8c30-4402-82e6-033069c012a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:14.806646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9539af-8c30-4402-82e6-033069c012a3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:14.813845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe5426-eedd-49cd-be14-b2d65b1c7ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:14.816520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe5426-eedd-49cd-be14-b2d65b1c7ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:14.816866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe5426-eedd-49cd-be14-b2d65b1c7ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:14.817188 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe5426-eedd-49cd-be14-b2d65b1c7ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:14.830664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe5426-eedd-49cd-be14-b2d65b1c7ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:14.832103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe5426-eedd-49cd-be14-b2d65b1c7ac1 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:14.857723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1072/2170] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:34:19.257141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae997-907c-4f0a-80fa-91f83900c8e5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:19.257846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae997-907c-4f0a-80fa-91f83900c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:19.257975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae997-907c-4f0a-80fa-91f83900c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:19.354177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-2dcae997-907c-4f0a-80fa-91f83900c8e5 None None] MFA Rules not processed for user `4f15801b4537460cb0bcb6c4984d4bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:19.355478 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2dcae997-907c-4f0a-80fa-91f83900c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:19.440971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:19.519260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1099/2171] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:19.537049 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe5426-eedd-49cd-be14-b2d65b1c7ac1 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:19.539910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2ebe5426-eedd-49cd-be14-b2d65b1c7ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:19.648002 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe5426-eedd-49cd-be14-b2d65b1c7ac1 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:19.653912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00fd34-cc4f-47cb-83e0-564a20d518de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfef506919f4914a7883bd99ea07615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:19.654735 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00fd34-cc4f-47cb-83e0-564a20d518de service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:19.655284 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00fd34-cc4f-47cb-83e0-564a20d518de service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:19.655758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00fd34-cc4f-47cb-83e0-564a20d518de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:19.657901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ff00fd34-cc4f-47cb-83e0-564a20d518de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:19.663515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:19.737471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00fd34-cc4f-47cb-83e0-564a20d518de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:19.740611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00fd34-cc4f-47cb-83e0-564a20d518de service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:19.770860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1073/2172] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:34:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:34:20.083103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1fac-df9e-483d-b614-2d546401fd09 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:20.083591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1fac-df9e-483d-b614-2d546401fd09 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:20.084610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1fac-df9e-483d-b614-2d546401fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:20.133688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-025b1fac-df9e-483d-b614-2d546401fd09 None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:20.135745 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-025b1fac-df9e-483d-b614-2d546401fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:20.328972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1100/2173] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:34:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:20.431335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00fd34-cc4f-47cb-83e0-564a20d518de service glance] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:20.435343 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ff00fd34-cc4f-47cb-83e0-564a20d518de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:20.650254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00fd34-cc4f-47cb-83e0-564a20d518de service glance] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:20.670483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585b00f-c5fd-43b1-89f4-2ba575b2c0d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:20.671351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585b00f-c5fd-43b1-89f4-2ba575b2c0d2 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:20.671805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585b00f-c5fd-43b1-89f4-2ba575b2c0d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:20.672243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585b00f-c5fd-43b1-89f4-2ba575b2c0d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:20.696289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585b00f-c5fd-43b1-89f4-2ba575b2c0d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:20.698197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585b00f-c5fd-43b1-89f4-2ba575b2c0d2 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:20.725518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1074/2174] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:34:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:34:20.848341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75573-9cd0-45a5-bd47-d51e7cb39768 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:20.849092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75573-9cd0-45a5-bd47-d51e7cb39768 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:20.849583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75573-9cd0-45a5-bd47-d51e7cb39768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:20.923274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-94f75573-9cd0-45a5-bd47-d51e7cb39768 None None] MFA Rules not processed for user `79deff91d5c046c4bbe7b2e47b21ba66`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:20.926028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-94f75573-9cd0-45a5-bd47-d51e7cb39768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:21.117890 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1101/2175] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:21.125632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585b00f-c5fd-43b1-89f4-2ba575b2c0d2 service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:21.127368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b585b00f-c5fd-43b1-89f4-2ba575b2c0d2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:21.450069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585b00f-c5fd-43b1-89f4-2ba575b2c0d2 service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:21.469137 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b016a-d80d-4756-bc40-3fa803a1d1a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:21.469862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b016a-d80d-4756-bc40-3fa803a1d1a8 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:21.470214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b016a-d80d-4756-bc40-3fa803a1d1a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:21.470607 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b016a-d80d-4756-bc40-3fa803a1d1a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:21.480859 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b016a-d80d-4756-bc40-3fa803a1d1a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:21.485955 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b016a-d80d-4756-bc40-3fa803a1d1a8 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:21.523671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1075/2176] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:34:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:34:24.328997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2e2e8-9c1a-447a-88c8-232edc8ca555 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:24.329601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2e2e8-9c1a-447a-88c8-232edc8ca555 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:24.330138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2e2e8-9c1a-447a-88c8-232edc8ca555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:24.384867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-dba2e2e8-9c1a-447a-88c8-232edc8ca555 None None] MFA Rules not processed for user `79deff91d5c046c4bbe7b2e47b21ba66`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:24.386858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-dba2e2e8-9c1a-447a-88c8-232edc8ca555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:24.397091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1102/2177] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:31.498559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:34.368642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=77 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:34.448754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be743c85-be11-4585-9caa-c23433494645 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:34.449342 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be743c85-be11-4585-9caa-c23433494645 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:34.449434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be743c85-be11-4585-9caa-c23433494645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:34.469854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-be743c85-be11-4585-9caa-c23433494645 None None] MFA Rules not processed for user `2dea780db38944c88428554903b3b1af`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:34.471073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-be743c85-be11-4585-9caa-c23433494645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:34.478210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1076/2178] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:36.898362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb47e20-c873-4c09-bbf9-b41508888ecf None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:36.898904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb47e20-c873-4c09-bbf9-b41508888ecf None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:36.898904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb47e20-c873-4c09-bbf9-b41508888ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:36.920063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0bb47e20-c873-4c09-bbf9-b41508888ecf None None] MFA Rules not processed for user `4d23a86c89cd44dbb39dbc7396b98e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:36.933098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0bb47e20-c873-4c09-bbf9-b41508888ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:37.002822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1103/2179] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:38.623977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be743c85-be11-4585-9caa-c23433494645 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:38.626059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-be743c85-be11-4585-9caa-c23433494645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:38.699273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be743c85-be11-4585-9caa-c23433494645 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:38.703015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52e505-52eb-49c2-a095-cbbf41a9558c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:38.703647 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52e505-52eb-49c2-a095-cbbf41a9558c service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:38.703942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52e505-52eb-49c2-a095-cbbf41a9558c service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:38.704236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52e505-52eb-49c2-a095-cbbf41a9558c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:38.706217 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5e52e505-52eb-49c2-a095-cbbf41a9558c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:38.767151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52e505-52eb-49c2-a095-cbbf41a9558c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:38.768597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52e505-52eb-49c2-a095-cbbf41a9558c service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:38.778655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1077/2180] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:34:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:34:42.894950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35f32-5d38-406b-9b16-69b443a5eb1f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:42.895429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35f32-5d38-406b-9b16-69b443a5eb1f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:42.895702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35f32-5d38-406b-9b16-69b443a5eb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:42.920578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7cd35f32-5d38-406b-9b16-69b443a5eb1f None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:34:42.921961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7cd35f32-5d38-406b-9b16-69b443a5eb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:34:42.936709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1104/2181] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:34:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:34:42.949040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52e505-52eb-49c2-a095-cbbf41a9558c service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:34:42.966338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52e505-52eb-49c2-a095-cbbf41a9558c service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:34:42.973716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417b7e-1a4e-4794-91bb-e2139a19b756 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:34:42.974617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417b7e-1a4e-4794-91bb-e2139a19b756 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:34:42.975334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417b7e-1a4e-4794-91bb-e2139a19b756 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:34:42.975774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417b7e-1a4e-4794-91bb-e2139a19b756 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:34:42.988317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417b7e-1a4e-4794-91bb-e2139a19b756 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:34:42.990498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417b7e-1a4e-4794-91bb-e2139a19b756 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:34:43.043636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1078/2182] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:34:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 10:34:52.912513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=28 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:53.000201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=59 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:05.629445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5ce1f-966c-455c-b455-51af86b75560 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:05.629917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5ce1f-966c-455c-b455-51af86b75560 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:05.630009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5ce1f-966c-455c-b455-51af86b75560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:05.649278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-f3b5ce1f-966c-455c-b455-51af86b75560 None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:05.650471 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-f3b5ce1f-966c-455c-b455-51af86b75560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:05.657854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1105/2183] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:35:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:05.669862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417b7e-1a4e-4794-91bb-e2139a19b756 service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:05.680207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417b7e-1a4e-4794-91bb-e2139a19b756 service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:05.685794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308862bb-13b9-4abc-a980-25c36bcfbf44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:05.686415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308862bb-13b9-4abc-a980-25c36bcfbf44 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:05.686695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308862bb-13b9-4abc-a980-25c36bcfbf44 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:05.686968 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308862bb-13b9-4abc-a980-25c36bcfbf44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:05.695056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308862bb-13b9-4abc-a980-25c36bcfbf44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:05.696614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308862bb-13b9-4abc-a980-25c36bcfbf44 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:05.705802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1079/2184] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:35:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:35:06.286063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532a84-31eb-4148-86f1-a7c603ef998d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:06.286352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532a84-31eb-4148-86f1-a7c603ef998d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:06.286703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c532a84-31eb-4148-86f1-a7c603ef998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:06.306854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3c532a84-31eb-4148-86f1-a7c603ef998d None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:06.308081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3c532a84-31eb-4148-86f1-a7c603ef998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:06.315341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1106/2185] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:06.328581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308862bb-13b9-4abc-a980-25c36bcfbf44 service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:06.339436 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308862bb-13b9-4abc-a980-25c36bcfbf44 service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:06.344337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc92219-cd6b-45e1-a720-84adcd0ceef4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:06.344915 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc92219-cd6b-45e1-a720-84adcd0ceef4 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:06.345222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc92219-cd6b-45e1-a720-84adcd0ceef4 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:06.345490 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc92219-cd6b-45e1-a720-84adcd0ceef4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:06.353411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc92219-cd6b-45e1-a720-84adcd0ceef4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:06.355580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc92219-cd6b-45e1-a720-84adcd0ceef4 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:06.364194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1080/2186] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:35:06.612112 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2169-5b88-4da3-b432-dd5e2f5c205a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:06.612408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2169-5b88-4da3-b432-dd5e2f5c205a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:06.612714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df2169-5b88-4da3-b432-dd5e2f5c205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:06.631694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-02df2169-5b88-4da3-b432-dd5e2f5c205a None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:06.633004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-02df2169-5b88-4da3-b432-dd5e2f5c205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:06.677568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1107/2187] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:35:06.693716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc92219-cd6b-45e1-a720-84adcd0ceef4 service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:06.712839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc92219-cd6b-45e1-a720-84adcd0ceef4 service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:06.720059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f395c41-e910-49b9-b596-f1c44f86b26c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:06.721230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f395c41-e910-49b9-b596-f1c44f86b26c service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:06.721570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f395c41-e910-49b9-b596-f1c44f86b26c service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:06.722277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f395c41-e910-49b9-b596-f1c44f86b26c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:06.745191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f395c41-e910-49b9-b596-f1c44f86b26c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:06.745191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f395c41-e910-49b9-b596-f1c44f86b26c service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:06.759028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1081/2188] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:35:07.158879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937d85-1e93-49ee-adcf-d3c3bcf9d52d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:07.159173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937d85-1e93-49ee-adcf-d3c3bcf9d52d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:07.159480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937d85-1e93-49ee-adcf-d3c3bcf9d52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:07.179763 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-10937d85-1e93-49ee-adcf-d3c3bcf9d52d None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:07.181100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-10937d85-1e93-49ee-adcf-d3c3bcf9d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:07.190549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1108/2189] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 10:35:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:35:07.204454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f395c41-e910-49b9-b596-f1c44f86b26c service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:07.215649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f395c41-e910-49b9-b596-f1c44f86b26c service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:07.221300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358db39-88ef-4a9a-9562-f199b546f7a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:07.222100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358db39-88ef-4a9a-9562-f199b546f7a3 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:07.222383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358db39-88ef-4a9a-9562-f199b546f7a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:07.222698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358db39-88ef-4a9a-9562-f199b546f7a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:07.231514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358db39-88ef-4a9a-9562-f199b546f7a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:07.233285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358db39-88ef-4a9a-9562-f199b546f7a3 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:07.242619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1082/2190] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:35:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 10:35:09.374002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937d85-1e93-49ee-adcf-d3c3bcf9d52d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:09.375444 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-10937d85-1e93-49ee-adcf-d3c3bcf9d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:09.390115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937d85-1e93-49ee-adcf-d3c3bcf9d52d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:09.394591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:09.395212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:09.395495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:09.395771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] PATH_INFO: `/v3/users/12bcee6ce3454d57824459e47b4b4ccf` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:09.396904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bcee6ce3454d57824459e47b4b4ccf)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:09.398835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:09.445754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bcee6ce3454d57824459e47b4b4ccf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:09.446409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bcee6ce3454d57824459e47b4b4ccf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:09.453600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bcee6ce3454d57824459e47b4b4ccf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:09.466723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bcee6ce3454d57824459e47b4b4ccf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:09.467409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bcee6ce3454d57824459e47b4b4ccf'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:09.481359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1109/2191] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:35:09 2022] DELETE /identity/v3/users/12bcee6ce3454d57824459e47b4b4ccf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:09.485482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a1775-fb4b-483f-9c5f-995cbd7eb9e6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:09.485944 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a1775-fb4b-483f-9c5f-995cbd7eb9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:09.486148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a1775-fb4b-483f-9c5f-995cbd7eb9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:09.505278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8a0a1775-fb4b-483f-9c5f-995cbd7eb9e6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:09.506579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8a0a1775-fb4b-483f-9c5f-995cbd7eb9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:09.573285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1083/2192] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:09.585868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:09.587953 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:09.649880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1b00c-8ed4-4566-9e45-cec3e089ad76 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:09.654433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4e576-3b39-481d-bfcc-4b2af0695af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:09.655046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4e576-3b39-481d-bfcc-4b2af0695af1 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:09.655349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4e576-3b39-481d-bfcc-4b2af0695af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:09.655645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4e576-3b39-481d-bfcc-4b2af0695af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:09.665549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4e576-3b39-481d-bfcc-4b2af0695af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:09.667285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4e576-3b39-481d-bfcc-4b2af0695af1 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:09.679488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1110/2193] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:35:09.871166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a1775-fb4b-483f-9c5f-995cbd7eb9e6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:09.873014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8a0a1775-fb4b-483f-9c5f-995cbd7eb9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:09.889600 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a1775-fb4b-483f-9c5f-995cbd7eb9e6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:09.898060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:09.899970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:09.901649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:09.902309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] PATH_INFO: `/v3/projects/7b28676620044f4d9e0a547ffc9d7c7c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:09.903757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b28676620044f4d9e0a547ffc9d7c7c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:09.906361 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:09.967454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b28676620044f4d9e0a547ffc9d7c7c', 'request_id': 'req-f7219d7b-ee81-4aa4-81e9-d0d20311660d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:09.974041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b28676620044f4d9e0a547ffc9d7c7c', 'request_id': 'req-f7219d7b-ee81-4aa4-81e9-d0d20311660d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:09.979605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b28676620044f4d9e0a547ffc9d7c7c', 'request_id': 'req-f7219d7b-ee81-4aa4-81e9-d0d20311660d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:09.993004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] The token cache is being invalidate because project 7b28676620044f4d9e0a547ffc9d7c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:35:09.993311 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:09.993942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f7219d7b-ee81-4aa4-81e9-d0d20311660d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:09.996337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1084/2194] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:35:09 2022] DELETE /identity/v3/projects/7b28676620044f4d9e0a547ffc9d7c7c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:10.001400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24c016-07de-4706-b186-7bec6446206e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:10.001681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24c016-07de-4706-b186-7bec6446206e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:10.001951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24c016-07de-4706-b186-7bec6446206e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:10.021988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-fa24c016-07de-4706-b186-7bec6446206e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:10.023196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fa24c016-07de-4706-b186-7bec6446206e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:10.068639 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:10.093262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1111/2195] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:10.101209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb608be-aef6-4d7d-8906-48031320421d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:10.101500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb608be-aef6-4d7d-8906-48031320421d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:10.101897 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb608be-aef6-4d7d-8906-48031320421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:10.121932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0bb608be-aef6-4d7d-8906-48031320421d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:10.123026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0bb608be-aef6-4d7d-8906-48031320421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:10.130982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1085/2196] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:10.135836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24c016-07de-4706-b186-7bec6446206e None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:10.145527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24c016-07de-4706-b186-7bec6446206e None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:10.150122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31505115-cb32-45b4-99a0-d1fa4e7e2a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:10.150765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31505115-cb32-45b4-99a0-d1fa4e7e2a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:10.151044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31505115-cb32-45b4-99a0-d1fa4e7e2a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:10.151313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31505115-cb32-45b4-99a0-d1fa4e7e2a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:10.151958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31505115-cb32-45b4-99a0-d1fa4e7e2a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:35:10.152283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31505115-cb32-45b4-99a0-d1fa4e7e2a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:10.153886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31505115-cb32-45b4-99a0-d1fa4e7e2a44 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:10.165575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1112/2197] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:35:10.169947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb608be-aef6-4d7d-8906-48031320421d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:10.180143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb608be-aef6-4d7d-8906-48031320421d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:10.185346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8cd9-0ba7-4375-897e-f51fe7b442df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:10.185942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8cd9-0ba7-4375-897e-f51fe7b442df admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:10.186222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8cd9-0ba7-4375-897e-f51fe7b442df admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:10.186497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8cd9-0ba7-4375-897e-f51fe7b442df admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:10.187135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d8cd9-0ba7-4375-897e-f51fe7b442df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:10.189143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d8cd9-0ba7-4375-897e-f51fe7b442df admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:10.220545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1086/2198] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:35:10 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:35:10.224851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31505115-cb32-45b4-99a0-d1fa4e7e2a44 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:10.234928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31505115-cb32-45b4-99a0-d1fa4e7e2a44 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:10.331191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b569-538f-4924-b831-092104bf54c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:10.332175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b569-538f-4924-b831-092104bf54c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:10.332523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b569-538f-4924-b831-092104bf54c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:10.332868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b569-538f-4924-b831-092104bf54c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:10.333617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942b569-538f-4924-b831-092104bf54c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:10.335621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942b569-538f-4924-b831-092104bf54c2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:10.364502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1113/2199] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:35:10 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:35:10.371770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8cd9-0ba7-4375-897e-f51fe7b442df admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:10.377462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:10.383701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8cd9-0ba7-4375-897e-f51fe7b442df admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:10.391140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118506f-2837-43d0-ac6e-5d2354e7dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:10.392167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118506f-2837-43d0-ac6e-5d2354e7dfcc admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:10.392453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118506f-2837-43d0-ac6e-5d2354e7dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:10.392730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118506f-2837-43d0-ac6e-5d2354e7dfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:10.393415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118506f-2837-43d0-ac6e-5d2354e7dfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:10.395040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118506f-2837-43d0-ac6e-5d2354e7dfcc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:10.407570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1087/2200] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:35:10.411159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b569-538f-4924-b831-092104bf54c2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:10.421290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b569-538f-4924-b831-092104bf54c2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:10.426036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a147b-d736-4e06-a270-22c385d05b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:10.426641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a147b-d736-4e06-a270-22c385d05b98 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:10.426922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a147b-d736-4e06-a270-22c385d05b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:10.427195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a147b-d736-4e06-a270-22c385d05b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:10.427842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a147b-d736-4e06-a270-22c385d05b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:10.429487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a147b-d736-4e06-a270-22c385d05b98 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:10.440269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1114/2201] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:35:10.444347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118506f-2837-43d0-ac6e-5d2354e7dfcc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:10.454980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118506f-2837-43d0-ac6e-5d2354e7dfcc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:10.459871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fe98b-4b0f-4149-9dae-ffda2fd85ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:10.460519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fe98b-4b0f-4149-9dae-ffda2fd85ced admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:10.460793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fe98b-4b0f-4149-9dae-ffda2fd85ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:10.461113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fe98b-4b0f-4149-9dae-ffda2fd85ced admin admin] PATH_INFO: `/v3/projects/6da9bda5e2b5453798bbb8aba28e1a9c/users/79a77000d242494ab613ea9b036fbb7b/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:10.476686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356fe98b-4b0f-4149-9dae-ffda2fd85ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da9bda5e2b5453798bbb8aba28e1a9c, user_id=79a77000d242494ab613ea9b036fbb7b, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:10.479422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356fe98b-4b0f-4149-9dae-ffda2fd85ced admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:10.503060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1088/2202] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:35:10 2022] PUT /identity/v3/projects/6da9bda5e2b5453798bbb8aba28e1a9c/users/79a77000d242494ab613ea9b036fbb7b/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:10.506421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df14fd0-62cf-4402-b245-8dfeb9d85ce1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:10.506956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df14fd0-62cf-4402-b245-8dfeb9d85ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:10.507375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df14fd0-62cf-4402-b245-8dfeb9d85ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:10.537511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-6df14fd0-62cf-4402-b245-8dfeb9d85ce1 None None] MFA Rules not processed for user `79a77000d242494ab613ea9b036fbb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:10.538744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-6df14fd0-62cf-4402-b245-8dfeb9d85ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:10.604450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1115/2203] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:10.616391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fe98b-4b0f-4149-9dae-ffda2fd85ced admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:10.618212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-356fe98b-4b0f-4149-9dae-ffda2fd85ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:10.683762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fe98b-4b0f-4149-9dae-ffda2fd85ced admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:10.687706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac7ec-1e02-4bb0-b886-9958d9309c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:10.688392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac7ec-1e02-4bb0-b886-9958d9309c52 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:10.688742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac7ec-1e02-4bb0-b886-9958d9309c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:10.689128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac7ec-1e02-4bb0-b886-9958d9309c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:10.699993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aac7ec-1e02-4bb0-b886-9958d9309c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:10.701860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aac7ec-1e02-4bb0-b886-9958d9309c52 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:10.711143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1089/2204] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:35:10 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:35:16.159874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df14fd0-62cf-4402-b245-8dfeb9d85ce1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:16.205604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:16.224220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df14fd0-62cf-4402-b245-8dfeb9d85ce1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:16.228785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:16.229459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:16.229743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:16.230014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] PATH_INFO: `/v3/users/79a77000d242494ab613ea9b036fbb7b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:16.231131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a77000d242494ab613ea9b036fbb7b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:16.233060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:16.278037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a77000d242494ab613ea9b036fbb7b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:16.278678 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a77000d242494ab613ea9b036fbb7b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:16.285482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a77000d242494ab613ea9b036fbb7b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:16.297038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a77000d242494ab613ea9b036fbb7b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:16.297649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a77000d242494ab613ea9b036fbb7b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:16.310380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1116/2205] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:35:16 2022] DELETE /identity/v3/users/79a77000d242494ab613ea9b036fbb7b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:16.315145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419b77f-fe9d-4678-801a-796784f008e4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:16.315604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419b77f-fe9d-4678-801a-796784f008e4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:16.315765 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419b77f-fe9d-4678-801a-796784f008e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:16.335413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b419b77f-fe9d-4678-801a-796784f008e4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:16.336590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b419b77f-fe9d-4678-801a-796784f008e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:16.394152 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1090/2206] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:16.404166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:16.405695 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:16.467614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1b24c-1aad-4764-a7b1-ebd8bbbfc6bd admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:16.471356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e7ca9-059e-422f-bfb1-e8c284202da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:16.471964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e7ca9-059e-422f-bfb1-e8c284202da9 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:16.472269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e7ca9-059e-422f-bfb1-e8c284202da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:16.472587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e7ca9-059e-422f-bfb1-e8c284202da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:16.482176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e7ca9-059e-422f-bfb1-e8c284202da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:16.483589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e7ca9-059e-422f-bfb1-e8c284202da9 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:16.493052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1117/2207] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:35:16.819407 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419b77f-fe9d-4678-801a-796784f008e4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:16.820919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b419b77f-fe9d-4678-801a-796784f008e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:16.834259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419b77f-fe9d-4678-801a-796784f008e4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:16.855424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:16.856144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:16.856368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:16.856666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] PATH_INFO: `/v3/projects/6da9bda5e2b5453798bbb8aba28e1a9c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:16.858950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da9bda5e2b5453798bbb8aba28e1a9c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:16.862105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:16.922658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da9bda5e2b5453798bbb8aba28e1a9c', 'request_id': 'req-d5044e69-a009-48de-bdf5-66da472b6a48'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:16.928967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da9bda5e2b5453798bbb8aba28e1a9c', 'request_id': 'req-d5044e69-a009-48de-bdf5-66da472b6a48'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:16.935928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da9bda5e2b5453798bbb8aba28e1a9c', 'request_id': 'req-d5044e69-a009-48de-bdf5-66da472b6a48'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:16.939086 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:16.952061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] The token cache is being invalidate because project 6da9bda5e2b5453798bbb8aba28e1a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:35:16.952563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:16.953237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:16.954724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1091/2208] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:35:16 2022] DELETE /identity/v3/projects/6da9bda5e2b5453798bbb8aba28e1a9c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:22.684308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de5c9d-d669-491f-891b-8bed974cbbc7 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:22.684787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de5c9d-d669-491f-891b-8bed974cbbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:22.685065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de5c9d-d669-491f-891b-8bed974cbbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:22.707431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-11de5c9d-d669-491f-891b-8bed974cbbc7 None None] MFA Rules not processed for user `85869eddd2924f85a318e77184c5607b`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:22.708746 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-11de5c9d-d669-491f-891b-8bed974cbbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:22.775825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1118/2209] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:23.237117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:23.238592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:23.320218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5044e69-a009-48de-bdf5-66da472b6a48 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:23.326585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:23.327257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:23.327791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:23.328227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] PATH_INFO: `/v3/users/2b72852a48094d8e891a6365004d5183` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:23.329431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b72852a48094d8e891a6365004d5183)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:23.331668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:23.389756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b72852a48094d8e891a6365004d5183'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.398761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b72852a48094d8e891a6365004d5183'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.399674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b72852a48094d8e891a6365004d5183'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.408153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b72852a48094d8e891a6365004d5183'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.424438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b72852a48094d8e891a6365004d5183'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.432192 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1092/2210] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:35:23 2022] DELETE /identity/v3/users/2b72852a48094d8e891a6365004d5183 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:23.638143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de5c9d-d669-491f-891b-8bed974cbbc7 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:23.653483 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de5c9d-d669-491f-891b-8bed974cbbc7 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:23.667836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:23.738614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:23.739313 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:23.739734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:23.739980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] PATH_INFO: `/v3/projects/53e5a9e9fe954268af10611296535d1b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:23.741402 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e5a9e9fe954268af10611296535d1b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:23.745185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:23.811921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e5a9e9fe954268af10611296535d1b', 'request_id': 'req-252ca4ba-63ea-465f-a55e-8ccc70b5f449'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.819196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e5a9e9fe954268af10611296535d1b', 'request_id': 'req-252ca4ba-63ea-465f-a55e-8ccc70b5f449'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.826878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e5a9e9fe954268af10611296535d1b', 'request_id': 'req-252ca4ba-63ea-465f-a55e-8ccc70b5f449'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.843232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] The token cache is being invalidate because project 53e5a9e9fe954268af10611296535d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:35:23.843554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.844771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.846655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1119/2211] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:35:23 2022] DELETE /identity/v3/projects/53e5a9e9fe954268af10611296535d1b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:23.851380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:23.853173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:23.867164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598dc44-bec9-45bb-b9c6-eab24d0983ab admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:23.930697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:23.931306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:23.931581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:23.931851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] PATH_INFO: `/v3/users/485d8d2bb5af491c896c964b90d4c911` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:23.933077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=485d8d2bb5af491c896c964b90d4c911)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:23.935084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:23.951999 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:23.991219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '485d8d2bb5af491c896c964b90d4c911'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:23.999453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '485d8d2bb5af491c896c964b90d4c911'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:24.000069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '485d8d2bb5af491c896c964b90d4c911'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:24.007815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '485d8d2bb5af491c896c964b90d4c911'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:24.022779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8682a98a-c4e6-4edb-bb7d-ece9e87ec23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '485d8d2bb5af491c896c964b90d4c911'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:24.030264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1093/2212] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:35:23 2022] DELETE /identity/v3/users/485d8d2bb5af491c896c964b90d4c911 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:24.209852 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:24.211563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:24.226264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ca4ba-63ea-465f-a55e-8ccc70b5f449 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:24.288108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:24.288749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:24.289123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:24.289398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] PATH_INFO: `/v3/projects/c4de6cd60bfd43619146c5af2431c4e4` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:24.290514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4de6cd60bfd43619146c5af2431c4e4)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:24.292444 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:24.338254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:24.342436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4de6cd60bfd43619146c5af2431c4e4', 'request_id': 'req-da19add2-6813-4aa6-bbbb-480f7f80308c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:24.351013 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4de6cd60bfd43619146c5af2431c4e4', 'request_id': 'req-da19add2-6813-4aa6-bbbb-480f7f80308c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:24.359159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4de6cd60bfd43619146c5af2431c4e4', 'request_id': 'req-da19add2-6813-4aa6-bbbb-480f7f80308c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:24.373950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] The token cache is being invalidate because project c4de6cd60bfd43619146c5af2431c4e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:35:24.374276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:24.374908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-da19add2-6813-4aa6-bbbb-480f7f80308c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:24.376419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1120/2213] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:35:24 2022] DELETE /identity/v3/projects/c4de6cd60bfd43619146c5af2431c4e4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:24.381370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af948e-de25-471a-a6b4-5b3fd12f8bb0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:24.381808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af948e-de25-471a-a6b4-5b3fd12f8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:24.381926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af948e-de25-471a-a6b4-5b3fd12f8bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:24.401986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-02af948e-de25-471a-a6b4-5b3fd12f8bb0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:24.403223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-02af948e-de25-471a-a6b4-5b3fd12f8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:24.469438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1094/2214] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:24.477201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544026a-0314-4619-b30e-0c181ee72046 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:24.477482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544026a-0314-4619-b30e-0c181ee72046 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:24.477751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544026a-0314-4619-b30e-0c181ee72046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:24.497711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7544026a-0314-4619-b30e-0c181ee72046 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:24.498830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7544026a-0314-4619-b30e-0c181ee72046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:24.507304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1121/2215] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:35:24.512245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af948e-de25-471a-a6b4-5b3fd12f8bb0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:24.522094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af948e-de25-471a-a6b4-5b3fd12f8bb0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:24.526845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11168c-52d7-4cd7-a216-14bfdbd204b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:24.527445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11168c-52d7-4cd7-a216-14bfdbd204b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:24.527728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11168c-52d7-4cd7-a216-14bfdbd204b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:24.528001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11168c-52d7-4cd7-a216-14bfdbd204b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:24.528713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11168c-52d7-4cd7-a216-14bfdbd204b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:35:24.529045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11168c-52d7-4cd7-a216-14bfdbd204b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:24.530705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11168c-52d7-4cd7-a216-14bfdbd204b6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:24.543257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1095/2216] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:35:24.548516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544026a-0314-4619-b30e-0c181ee72046 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:24.559469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544026a-0314-4619-b30e-0c181ee72046 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:24.564403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27930405-9fce-4d7b-aed8-e429ca19b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:24.565055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27930405-9fce-4d7b-aed8-e429ca19b507 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:24.565338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27930405-9fce-4d7b-aed8-e429ca19b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:24.565607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27930405-9fce-4d7b-aed8-e429ca19b507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:24.566241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27930405-9fce-4d7b-aed8-e429ca19b507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:24.568135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27930405-9fce-4d7b-aed8-e429ca19b507 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:24.601381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1122/2217] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:35:24 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:35:24.602548 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11168c-52d7-4cd7-a216-14bfdbd204b6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:24.613928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11168c-52d7-4cd7-a216-14bfdbd204b6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:24.673271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edddb1c-0d4d-4e95-bfcd-86aeb067e3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:24.673883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edddb1c-0d4d-4e95-bfcd-86aeb067e3fc admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:24.674213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edddb1c-0d4d-4e95-bfcd-86aeb067e3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:24.674490 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edddb1c-0d4d-4e95-bfcd-86aeb067e3fc admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:24.675113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edddb1c-0d4d-4e95-bfcd-86aeb067e3fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:24.677083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edddb1c-0d4d-4e95-bfcd-86aeb067e3fc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:24.704984 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1096/2218] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:35:24 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:35:24.707609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27930405-9fce-4d7b-aed8-e429ca19b507 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:24.721760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27930405-9fce-4d7b-aed8-e429ca19b507 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:24.728407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdf41a-1237-4ea1-9d01-1b416e95530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:24.729839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf41a-1237-4ea1-9d01-1b416e95530b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:24.730170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf41a-1237-4ea1-9d01-1b416e95530b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:24.730443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf41a-1237-4ea1-9d01-1b416e95530b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:24.731413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdf41a-1237-4ea1-9d01-1b416e95530b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:24.733689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdf41a-1237-4ea1-9d01-1b416e95530b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:24.745461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1123/2219] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:35:24.749487 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edddb1c-0d4d-4e95-bfcd-86aeb067e3fc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:24.760035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edddb1c-0d4d-4e95-bfcd-86aeb067e3fc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:24.765312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd52128-099d-42c7-b1f4-ad864db0c225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:24.765973 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd52128-099d-42c7-b1f4-ad864db0c225 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:24.766300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd52128-099d-42c7-b1f4-ad864db0c225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:24.766579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd52128-099d-42c7-b1f4-ad864db0c225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:24.767418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd52128-099d-42c7-b1f4-ad864db0c225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:24.769134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd52128-099d-42c7-b1f4-ad864db0c225 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:24.771723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:24.781585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1097/2220] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:35:24.785911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdf41a-1237-4ea1-9d01-1b416e95530b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:24.797215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdf41a-1237-4ea1-9d01-1b416e95530b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:24.802142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d225da0-a779-4040-9d65-a70ee7e32c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:24.802841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d225da0-a779-4040-9d65-a70ee7e32c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:24.803122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d225da0-a779-4040-9d65-a70ee7e32c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:24.803406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d225da0-a779-4040-9d65-a70ee7e32c0e admin admin] PATH_INFO: `/v3/projects/db57a9d8ebce48c79dc24d3ad4d28922/users/6920a0846e4f45dba6f90f1e216f6a56/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:24.819361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d225da0-a779-4040-9d65-a70ee7e32c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db57a9d8ebce48c79dc24d3ad4d28922, user_id=6920a0846e4f45dba6f90f1e216f6a56, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:24.822021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d225da0-a779-4040-9d65-a70ee7e32c0e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:24.835112 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1124/2221] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:35:24 2022] PUT /identity/v3/projects/db57a9d8ebce48c79dc24d3ad4d28922/users/6920a0846e4f45dba6f90f1e216f6a56/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:24.845443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cdee7-6349-4490-b9a9-cb683cd0c318 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:24.845744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cdee7-6349-4490-b9a9-cb683cd0c318 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:24.846016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cdee7-6349-4490-b9a9-cb683cd0c318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:24.873748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-635cdee7-6349-4490-b9a9-cb683cd0c318 None None] MFA Rules not processed for user `6920a0846e4f45dba6f90f1e216f6a56`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:24.874949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-635cdee7-6349-4490-b9a9-cb683cd0c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:24.936551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1098/2222] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:24.948170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d225da0-a779-4040-9d65-a70ee7e32c0e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:24.949851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5d225da0-a779-4040-9d65-a70ee7e32c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:25.005602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d225da0-a779-4040-9d65-a70ee7e32c0e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:25.009178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f35f5-2d42-421d-8e5c-e62a042f3c53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfef506919f4914a7883bd99ea07615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:25.009775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f35f5-2d42-421d-8e5c-e62a042f3c53 service glance] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:25.010055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f35f5-2d42-421d-8e5c-e62a042f3c53 service glance] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:25.010327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f35f5-2d42-421d-8e5c-e62a042f3c53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:25.018435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f35f5-2d42-421d-8e5c-e62a042f3c53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:25.019825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f35f5-2d42-421d-8e5c-e62a042f3c53 service glance] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:25.028983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1125/2223] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:35:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:35:28.141309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cdee7-6349-4490-b9a9-cb683cd0c318 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:28.142889 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-635cdee7-6349-4490-b9a9-cb683cd0c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:28.268737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cdee7-6349-4490-b9a9-cb683cd0c318 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:28.275249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22c0cd-4051-4277-b883-dd1f8bbb493b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:28.276691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22c0cd-4051-4277-b883-dd1f8bbb493b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:28.277451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22c0cd-4051-4277-b883-dd1f8bbb493b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:28.277451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22c0cd-4051-4277-b883-dd1f8bbb493b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:28.279043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8b22c0cd-4051-4277-b883-dd1f8bbb493b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:28.343410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22c0cd-4051-4277-b883-dd1f8bbb493b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:28.344838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22c0cd-4051-4277-b883-dd1f8bbb493b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:28.354293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1099/2224] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:35:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:35:31.328241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37834bf-f394-4434-ab74-2f8de3209403 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:31.328740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37834bf-f394-4434-ab74-2f8de3209403 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:31.328900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37834bf-f394-4434-ab74-2f8de3209403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:31.350977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c37834bf-f394-4434-ab74-2f8de3209403 None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:31.352268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c37834bf-f394-4434-ab74-2f8de3209403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:31.422413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1126/2225] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:35:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:31.447808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22c0cd-4051-4277-b883-dd1f8bbb493b service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:31.449470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8b22c0cd-4051-4277-b883-dd1f8bbb493b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:31.520748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:31.554924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22c0cd-4051-4277-b883-dd1f8bbb493b service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:31.561670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06913aa-e944-4566-b52a-d748e1911be3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:31.562513 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06913aa-e944-4566-b52a-d748e1911be3 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:31.562857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06913aa-e944-4566-b52a-d748e1911be3 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:31.563799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06913aa-e944-4566-b52a-d748e1911be3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:31.575792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06913aa-e944-4566-b52a-d748e1911be3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:31.578140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06913aa-e944-4566-b52a-d748e1911be3 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:31.593130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1100/2226] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:35:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 10:35:41.414806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=86,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:41.584002 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=15 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:55.308152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bb9ff-947f-4106-b898-291480bfa23d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:55.308678 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bb9ff-947f-4106-b898-291480bfa23d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:55.308776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bb9ff-947f-4106-b898-291480bfa23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:55.327701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-764bb9ff-947f-4106-b898-291480bfa23d None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:55.329213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-764bb9ff-947f-4106-b898-291480bfa23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:55.336184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1127/2227] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 10:35:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:55.349140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06913aa-e944-4566-b52a-d748e1911be3 service swift] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:55.359657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06913aa-e944-4566-b52a-d748e1911be3 service swift] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:55.365470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4e5bf-c973-477d-93cb-080f37997575 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:55.366064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e5bf-c973-477d-93cb-080f37997575 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:55.366344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e5bf-c973-477d-93cb-080f37997575 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:55.366612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e5bf-c973-477d-93cb-080f37997575 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:55.374879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4e5bf-c973-477d-93cb-080f37997575 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:55.376455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4e5bf-c973-477d-93cb-080f37997575 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:55.384304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1101/2228] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:35:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:35:57.492676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712275b-d3fe-4988-8f35-68ff1795db19 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:57.493204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712275b-d3fe-4988-8f35-68ff1795db19 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:57.493376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712275b-d3fe-4988-8f35-68ff1795db19 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:57.494794 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1128/2229] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:35:57.514088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f53b5-f6ef-46c8-a8d8-fa2d61fa56a8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:57.514590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f53b5-f6ef-46c8-a8d8-fa2d61fa56a8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:57.514708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f53b5-f6ef-46c8-a8d8-fa2d61fa56a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:57.534431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-795f53b5-f6ef-46c8-a8d8-fa2d61fa56a8 None None] MFA Rules not processed for user `794990333d3748abad7683590b0e5d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:57.535673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-795f53b5-f6ef-46c8-a8d8-fa2d61fa56a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:57.613474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712275b-d3fe-4988-8f35-68ff1795db19 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:57.617892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2712275b-d3fe-4988-8f35-68ff1795db19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:57.629641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1102/2230] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:35:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:57.649771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f53b5-f6ef-46c8-a8d8-fa2d61fa56a8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:57.651168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-795f53b5-f6ef-46c8-a8d8-fa2d61fa56a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:57.664933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f53b5-f6ef-46c8-a8d8-fa2d61fa56a8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:57.670257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155baf9-5dd3-40df-8fe4-b9ca31a32b99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:57.670865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155baf9-5dd3-40df-8fe4-b9ca31a32b99 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:57.671142 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155baf9-5dd3-40df-8fe4-b9ca31a32b99 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:57.671408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155baf9-5dd3-40df-8fe4-b9ca31a32b99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:57.680664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155baf9-5dd3-40df-8fe4-b9ca31a32b99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:57.682264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155baf9-5dd3-40df-8fe4-b9ca31a32b99 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:57.692531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712275b-d3fe-4988-8f35-68ff1795db19 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:57.692680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1103/2231] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:35:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:35:57.697287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:57.697899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:57.698177 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:57.698447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] PATH_INFO: `/v3/users/4d23a86c89cd44dbb39dbc7396b98e0f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:57.699577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d23a86c89cd44dbb39dbc7396b98e0f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:57.702033 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:57.748332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d23a86c89cd44dbb39dbc7396b98e0f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:57.749038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d23a86c89cd44dbb39dbc7396b98e0f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:57.755929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d23a86c89cd44dbb39dbc7396b98e0f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:57.767917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d23a86c89cd44dbb39dbc7396b98e0f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:57.768555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-83026f7d-6f34-4a97-b567-845c0252e37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d23a86c89cd44dbb39dbc7396b98e0f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:57.782089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1129/2232] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:35:57 2022] DELETE /identity/v3/users/4d23a86c89cd44dbb39dbc7396b98e0f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:35:57.950006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155baf9-5dd3-40df-8fe4-b9ca31a32b99 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:57.963315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155baf9-5dd3-40df-8fe4-b9ca31a32b99 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:58.028385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:58.029103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.029384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.029660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] PATH_INFO: `/v3/projects/2285bddb311f455fb973e364c157923f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.030791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2285bddb311f455fb973e364c157923f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:58.032702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:58.078883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2285bddb311f455fb973e364c157923f', 'request_id': 'req-c55ce2ad-6bd3-46b8-be95-6810eb83c853'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:58.085127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2285bddb311f455fb973e364c157923f', 'request_id': 'req-c55ce2ad-6bd3-46b8-be95-6810eb83c853'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:58.090707 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2285bddb311f455fb973e364c157923f', 'request_id': 'req-c55ce2ad-6bd3-46b8-be95-6810eb83c853'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:58.099624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:58.104085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] The token cache is being invalidate because project 2285bddb311f455fb973e364c157923f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:35:58.104553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:58.105281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c55ce2ad-6bd3-46b8-be95-6810eb83c853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:35:58.107161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1104/2233] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:35:57 2022] DELETE /identity/v3/projects/2285bddb311f455fb973e364c157923f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:58.113649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5bb57-dd1f-4c14-b1bd-99da17c00dd9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.113959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5bb57-dd1f-4c14-b1bd-99da17c00dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.114234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5bb57-dd1f-4c14-b1bd-99da17c00dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.133908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b0b5bb57-dd1f-4c14-b1bd-99da17c00dd9 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:58.135107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b0b5bb57-dd1f-4c14-b1bd-99da17c00dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:58.196034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1130/2234] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:58.204844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97925f1e-1085-4608-a81e-78d2c2d212aa None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.205163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97925f1e-1085-4608-a81e-78d2c2d212aa None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.205463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97925f1e-1085-4608-a81e-78d2c2d212aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.225073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-97925f1e-1085-4608-a81e-78d2c2d212aa None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:58.226290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-97925f1e-1085-4608-a81e-78d2c2d212aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:58.234427 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1105/2235] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:58.238819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5bb57-dd1f-4c14-b1bd-99da17c00dd9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:58.248856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5bb57-dd1f-4c14-b1bd-99da17c00dd9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:58.253396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab90b9-2584-4205-b166-44df03040718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:58.253986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab90b9-2584-4205-b166-44df03040718 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.254266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab90b9-2584-4205-b166-44df03040718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.254539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab90b9-2584-4205-b166-44df03040718 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.255180 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab90b9-2584-4205-b166-44df03040718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:35:58.255512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab90b9-2584-4205-b166-44df03040718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:58.257110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab90b9-2584-4205-b166-44df03040718 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:58.266823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:58.276703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1131/2236] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:35:58.277574 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97925f1e-1085-4608-a81e-78d2c2d212aa None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:58.287478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97925f1e-1085-4608-a81e-78d2c2d212aa None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:58.292418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22c6f8-c61f-4234-88c1-e765d67ee1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:58.293058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22c6f8-c61f-4234-88c1-e765d67ee1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.293343 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22c6f8-c61f-4234-88c1-e765d67ee1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.293622 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22c6f8-c61f-4234-88c1-e765d67ee1c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.294800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22c6f8-c61f-4234-88c1-e765d67ee1c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:58.296685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22c6f8-c61f-4234-88c1-e765d67ee1c9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:58.327042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1106/2237] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:35:58 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:35:58.335996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab90b9-2584-4205-b166-44df03040718 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:58.347588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab90b9-2584-4205-b166-44df03040718 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:58.531797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d29ae-534e-445b-bb4d-ce415b3844d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:58.532423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d29ae-534e-445b-bb4d-ce415b3844d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.533057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d29ae-534e-445b-bb4d-ce415b3844d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.533174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d29ae-534e-445b-bb4d-ce415b3844d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.533785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d29ae-534e-445b-bb4d-ce415b3844d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:58.536108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d29ae-534e-445b-bb4d-ce415b3844d8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:58.560742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1132/2238] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:35:58 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:35:58.564016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22c6f8-c61f-4234-88c1-e765d67ee1c9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:58.576175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22c6f8-c61f-4234-88c1-e765d67ee1c9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:58.583275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefafbe-fd17-484e-9e08-3b759cda9bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:58.584070 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefafbe-fd17-484e-9e08-3b759cda9bea admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.584433 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefafbe-fd17-484e-9e08-3b759cda9bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.585276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefafbe-fd17-484e-9e08-3b759cda9bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.586039 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefafbe-fd17-484e-9e08-3b759cda9bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:58.588356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefafbe-fd17-484e-9e08-3b759cda9bea admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:58.612737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1107/2239] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:35:58.616744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d29ae-534e-445b-bb4d-ce415b3844d8 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:58.635380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d29ae-534e-445b-bb4d-ce415b3844d8 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:58.642448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624138b-ad11-4f02-9df8-eb55aa6e1883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:58.643933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624138b-ad11-4f02-9df8-eb55aa6e1883 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.644217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624138b-ad11-4f02-9df8-eb55aa6e1883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.644491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624138b-ad11-4f02-9df8-eb55aa6e1883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.646966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624138b-ad11-4f02-9df8-eb55aa6e1883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:58.649846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624138b-ad11-4f02-9df8-eb55aa6e1883 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:58.665043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1133/2240] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:35:58.677158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefafbe-fd17-484e-9e08-3b759cda9bea admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:58.684697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefafbe-fd17-484e-9e08-3b759cda9bea admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:58.689708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd5726-e754-4c99-9dd4-fdabee6bc424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:58.690395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd5726-e754-4c99-9dd4-fdabee6bc424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.690674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd5726-e754-4c99-9dd4-fdabee6bc424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.690966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd5726-e754-4c99-9dd4-fdabee6bc424 admin admin] PATH_INFO: `/v3/projects/721fea451c95496eab7d3278e8b66126/users/36b04859aac64e9e9157e1188c1b224c/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.711495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd5726-e754-4c99-9dd4-fdabee6bc424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=721fea451c95496eab7d3278e8b66126, user_id=36b04859aac64e9e9157e1188c1b224c, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:58.717099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd5726-e754-4c99-9dd4-fdabee6bc424 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:58.732890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1108/2241] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:35:58 2022] PUT /identity/v3/projects/721fea451c95496eab7d3278e8b66126/users/36b04859aac64e9e9157e1188c1b224c/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:35:58.738036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15210f-a319-4b34-8177-6aa14a0c8c56 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.738370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15210f-a319-4b34-8177-6aa14a0c8c56 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.739245 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15210f-a319-4b34-8177-6aa14a0c8c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.759175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8d15210f-a319-4b34-8177-6aa14a0c8c56 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:35:58.760387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8d15210f-a319-4b34-8177-6aa14a0c8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:58.819617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1134/2242] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:35:58.830491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd5726-e754-4c99-9dd4-fdabee6bc424 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:35:58.832386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57dd5726-e754-4c99-9dd4-fdabee6bc424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:35:58.905543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd5726-e754-4c99-9dd4-fdabee6bc424 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:35:58.909230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7effc-34f7-436a-8dbc-2aa567fad3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:35:58.909834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7effc-34f7-436a-8dbc-2aa567fad3ac service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:35:58.910113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7effc-34f7-436a-8dbc-2aa567fad3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:35:58.910384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7effc-34f7-436a-8dbc-2aa567fad3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:35:58.919107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7effc-34f7-436a-8dbc-2aa567fad3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:35:58.921124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7effc-34f7-436a-8dbc-2aa567fad3ac service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:35:58.930290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1109/2243] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:36:03.652564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb983c-778d-453c-8e05-c67f3a82a539 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:03.653167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb983c-778d-453c-8e05-c67f3a82a539 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:03.653167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb983c-778d-453c-8e05-c67f3a82a539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:03.690300 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-60eb983c-778d-453c-8e05-c67f3a82a539 None None] MFA Rules not processed for user `36b04859aac64e9e9157e1188c1b224c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:03.691676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-60eb983c-778d-453c-8e05-c67f3a82a539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:03.768081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1135/2244] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:03.772677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7effc-34f7-436a-8dbc-2aa567fad3ac service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:03.784585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7effc-34f7-436a-8dbc-2aa567fad3ac service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:03.791390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d3d03-d89f-4053-b076-37b000c416ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:03.792281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d3d03-d89f-4053-b076-37b000c416ba admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:03.792810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d3d03-d89f-4053-b076-37b000c416ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:03.793320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d3d03-d89f-4053-b076-37b000c416ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:03.794114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d3d03-d89f-4053-b076-37b000c416ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:03.796103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d3d03-d89f-4053-b076-37b000c416ba admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:03.828936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1110/2245] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:36:03 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:36:03.830387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb983c-778d-453c-8e05-c67f3a82a539 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:03.842270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb983c-778d-453c-8e05-c67f3a82a539 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:03.846880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:03.903567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013c442-1438-4088-a863-5db86e7b06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:03.904742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c442-1438-4088-a863-5db86e7b06b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:03.905051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c442-1438-4088-a863-5db86e7b06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:03.905323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c442-1438-4088-a863-5db86e7b06b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:03.905948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013c442-1438-4088-a863-5db86e7b06b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:03.907839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013c442-1438-4088-a863-5db86e7b06b3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:03.932515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1136/2246] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:36:03 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:36:03.933726 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d3d03-d89f-4053-b076-37b000c416ba admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:03.945926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d3d03-d89f-4053-b076-37b000c416ba admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:03.951061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cacd6-fb39-49f7-a158-1f1e4af77cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:03.951684 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cacd6-fb39-49f7-a158-1f1e4af77cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:03.951966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cacd6-fb39-49f7-a158-1f1e4af77cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:03.952398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cacd6-fb39-49f7-a158-1f1e4af77cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:03.953149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cacd6-fb39-49f7-a158-1f1e4af77cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:03.955659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cacd6-fb39-49f7-a158-1f1e4af77cd6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:03.967534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1111/2247] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:36:03.975381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013c442-1438-4088-a863-5db86e7b06b3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:03.985242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013c442-1438-4088-a863-5db86e7b06b3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:03.990265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab7b9-7afa-4253-9509-7a4ba8b1b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:03.991087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab7b9-7afa-4253-9509-7a4ba8b1b1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:03.991380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab7b9-7afa-4253-9509-7a4ba8b1b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:03.991656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab7b9-7afa-4253-9509-7a4ba8b1b1c5 admin admin] PATH_INFO: `/v3/projects/0045dc38b8ff487aa433ed15689d5a44/users/861dae3b1620455a9e55eebbce30a9dd/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:04.011196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbab7b9-7afa-4253-9509-7a4ba8b1b1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0045dc38b8ff487aa433ed15689d5a44, user_id=861dae3b1620455a9e55eebbce30a9dd, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:04.014328 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbab7b9-7afa-4253-9509-7a4ba8b1b1c5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:04.037081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1137/2248] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:36:03 2022] PUT /identity/v3/projects/0045dc38b8ff487aa433ed15689d5a44/users/861dae3b1620455a9e55eebbce30a9dd/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:04.041538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cacd6-fb39-49f7-a158-1f1e4af77cd6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:04.054103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cacd6-fb39-49f7-a158-1f1e4af77cd6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:04.131054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0339a2-ab9a-40da-9152-31a44cfd5230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:04.131675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0339a2-ab9a-40da-9152-31a44cfd5230 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:04.131953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0339a2-ab9a-40da-9152-31a44cfd5230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:04.132220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0339a2-ab9a-40da-9152-31a44cfd5230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:04.133584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0339a2-ab9a-40da-9152-31a44cfd5230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:04.135236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0339a2-ab9a-40da-9152-31a44cfd5230 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:04.150934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1112/2249] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:36:04.157072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab7b9-7afa-4253-9509-7a4ba8b1b1c5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:04.168761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab7b9-7afa-4253-9509-7a4ba8b1b1c5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:04.173946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8f59d-407f-49b0-93d2-b103163962dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:04.174612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f59d-407f-49b0-93d2-b103163962dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:04.174889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f59d-407f-49b0-93d2-b103163962dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:04.175157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f59d-407f-49b0-93d2-b103163962dd admin admin] PATH_INFO: `/v3/projects/0045dc38b8ff487aa433ed15689d5a44/users/861dae3b1620455a9e55eebbce30a9dd/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:04.177323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8f59d-407f-49b0-93d2-b103163962dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0045dc38b8ff487aa433ed15689d5a44, user_id=861dae3b1620455a9e55eebbce30a9dd, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:04.179929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8f59d-407f-49b0-93d2-b103163962dd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:04.196260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1138/2250] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:36:04 2022] PUT /identity/v3/projects/0045dc38b8ff487aa433ed15689d5a44/users/861dae3b1620455a9e55eebbce30a9dd/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:05.467884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0339a2-ab9a-40da-9152-31a44cfd5230 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:05.470626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7b0339a2-ab9a-40da-9152-31a44cfd5230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:05.479101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:05.492564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0339a2-ab9a-40da-9152-31a44cfd5230 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:05.634082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:05.636118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:05.636975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:05.637471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] PATH_INFO: `/v3/users/6920a0846e4f45dba6f90f1e216f6a56` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:05.639188 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6920a0846e4f45dba6f90f1e216f6a56)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:05.642629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:05.711818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6920a0846e4f45dba6f90f1e216f6a56'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:05.721713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6920a0846e4f45dba6f90f1e216f6a56'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:05.722437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6920a0846e4f45dba6f90f1e216f6a56'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:05.731838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6920a0846e4f45dba6f90f1e216f6a56'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:05.750472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6920a0846e4f45dba6f90f1e216f6a56'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:05.760307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1113/2251] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:36:05 2022] DELETE /identity/v3/users/6920a0846e4f45dba6f90f1e216f6a56 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:05.762202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332accec-fbd3-4605-929b-35c5779df79b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:05.762712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332accec-fbd3-4605-929b-35c5779df79b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:05.762881 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332accec-fbd3-4605-929b-35c5779df79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:05.789985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-332accec-fbd3-4605-929b-35c5779df79b None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:05.792685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-332accec-fbd3-4605-929b-35c5779df79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:05.892837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1139/2252] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:05.906880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:05.908425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:06.000774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d033e5d-d8d2-4867-ac87-f2e62cc10556 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:06.006827 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576f0ec-3a93-4caf-b166-9fa090a36cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:06.007279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f0ec-3a93-4caf-b166-9fa090a36cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:06.007649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f0ec-3a93-4caf-b166-9fa090a36cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:06.008286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576f0ec-3a93-4caf-b166-9fa090a36cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:06.025563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576f0ec-3a93-4caf-b166-9fa090a36cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:06.028550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576f0ec-3a93-4caf-b166-9fa090a36cb3 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:06.041954 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1114/2253] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:36:06.517548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332accec-fbd3-4605-929b-35c5779df79b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:06.519092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-332accec-fbd3-4605-929b-35c5779df79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:06.549390 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332accec-fbd3-4605-929b-35c5779df79b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:06.556098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:06.556756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:06.558835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:06.559115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] PATH_INFO: `/v3/projects/db57a9d8ebce48c79dc24d3ad4d28922` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:06.578254 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db57a9d8ebce48c79dc24d3ad4d28922)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:06.580830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:06.724100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db57a9d8ebce48c79dc24d3ad4d28922', 'request_id': 'req-fc26f7c1-b304-4633-9f2b-beb08a3897f9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:06.733265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db57a9d8ebce48c79dc24d3ad4d28922', 'request_id': 'req-fc26f7c1-b304-4633-9f2b-beb08a3897f9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:06.738952 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:06.745289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db57a9d8ebce48c79dc24d3ad4d28922', 'request_id': 'req-fc26f7c1-b304-4633-9f2b-beb08a3897f9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:06.780984 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] The token cache is being invalidate because project db57a9d8ebce48c79dc24d3ad4d28922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:36:06.782602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:06.789132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fc26f7c1-b304-4633-9f2b-beb08a3897f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:06.791922 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1140/2254] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:36:06 2022] DELETE /identity/v3/projects/db57a9d8ebce48c79dc24d3ad4d28922 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:06.801536 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca3fa-6af0-4826-bed1-40f8b3320d95 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:06.802020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca3fa-6af0-4826-bed1-40f8b3320d95 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:06.804965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca3fa-6af0-4826-bed1-40f8b3320d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:06.863215 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f1eca3fa-6af0-4826-bed1-40f8b3320d95 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:06.864577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f1eca3fa-6af0-4826-bed1-40f8b3320d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:06.893230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:06.961193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1115/2255] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:06.966828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4403-e705-4ed5-a56c-9039febd955f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:06.967924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4403-e705-4ed5-a56c-9039febd955f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:06.968385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4403-e705-4ed5-a56c-9039febd955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:06.995625 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a93c4403-e705-4ed5-a56c-9039febd955f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:06.997231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a93c4403-e705-4ed5-a56c-9039febd955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:07.030065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1141/2256] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:07.034439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eca3fa-6af0-4826-bed1-40f8b3320d95 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:07.044610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eca3fa-6af0-4826-bed1-40f8b3320d95 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:07.055769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4d99e-715e-4c17-932e-8202d9aca46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:07.056712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4d99e-715e-4c17-932e-8202d9aca46c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:07.057247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4d99e-715e-4c17-932e-8202d9aca46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:07.057617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4d99e-715e-4c17-932e-8202d9aca46c admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:07.058390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4d99e-715e-4c17-932e-8202d9aca46c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:36:07.058800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4d99e-715e-4c17-932e-8202d9aca46c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:07.061744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4d99e-715e-4c17-932e-8202d9aca46c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:07.098159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4403-e705-4ed5-a56c-9039febd955f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:07.098492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1116/2257] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:36:07.116589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4403-e705-4ed5-a56c-9039febd955f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:07.129918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595ece1-4b97-45e9-b853-6d441fda33b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:07.129918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ece1-4b97-45e9-b853-6d441fda33b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:07.130187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ece1-4b97-45e9-b853-6d441fda33b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:07.130356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ece1-4b97-45e9-b853-6d441fda33b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:07.131137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595ece1-4b97-45e9-b853-6d441fda33b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:07.133083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595ece1-4b97-45e9-b853-6d441fda33b3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:07.200642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1142/2258] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:36:07 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:36:07.205727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4d99e-715e-4c17-932e-8202d9aca46c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:07.220818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4d99e-715e-4c17-932e-8202d9aca46c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:07.383064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ae35-405e-44d1-8cb6-7f97d93a1dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:07.383700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ae35-405e-44d1-8cb6-7f97d93a1dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:07.383980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ae35-405e-44d1-8cb6-7f97d93a1dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:07.384253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ae35-405e-44d1-8cb6-7f97d93a1dbb admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:07.385136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117ae35-405e-44d1-8cb6-7f97d93a1dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:07.387254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117ae35-405e-44d1-8cb6-7f97d93a1dbb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:07.430495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1117/2259] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:36:07 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:36:07.442043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595ece1-4b97-45e9-b853-6d441fda33b3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:07.475010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595ece1-4b97-45e9-b853-6d441fda33b3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:07.488134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c3d8-3514-4a4c-96b3-e67c3fc2dc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:07.488769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c3d8-3514-4a4c-96b3-e67c3fc2dc2c admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:07.489079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c3d8-3514-4a4c-96b3-e67c3fc2dc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:07.489355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c3d8-3514-4a4c-96b3-e67c3fc2dc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:07.490014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330c3d8-3514-4a4c-96b3-e67c3fc2dc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:07.491624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330c3d8-3514-4a4c-96b3-e67c3fc2dc2c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:07.518512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1143/2260] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:36:07.522992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ae35-405e-44d1-8cb6-7f97d93a1dbb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:07.543921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ae35-405e-44d1-8cb6-7f97d93a1dbb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:07.557128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938eeb93-545d-47a5-866a-9844a9d5737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:07.558190 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938eeb93-545d-47a5-866a-9844a9d5737b admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:07.558571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938eeb93-545d-47a5-866a-9844a9d5737b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:07.559705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938eeb93-545d-47a5-866a-9844a9d5737b admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:07.561307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938eeb93-545d-47a5-866a-9844a9d5737b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:07.563298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938eeb93-545d-47a5-866a-9844a9d5737b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:07.581168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1118/2261] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:36:07.587330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c3d8-3514-4a4c-96b3-e67c3fc2dc2c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:07.601109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c3d8-3514-4a4c-96b3-e67c3fc2dc2c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:07.618653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf99c3-095f-4eac-94e9-c3b1190417d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:07.619640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf99c3-095f-4eac-94e9-c3b1190417d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:07.620709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf99c3-095f-4eac-94e9-c3b1190417d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:07.621589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf99c3-095f-4eac-94e9-c3b1190417d6 admin admin] PATH_INFO: `/v3/projects/90ed237b4dea4778bd5acab2b1c668b4/users/17cc2c85f2254d3f9b82c2916ef6f61b/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:07.655758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf99c3-095f-4eac-94e9-c3b1190417d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ed237b4dea4778bd5acab2b1c668b4, user_id=17cc2c85f2254d3f9b82c2916ef6f61b, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:07.659770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf99c3-095f-4eac-94e9-c3b1190417d6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:07.680028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1144/2262] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:36:07 2022] PUT /identity/v3/projects/90ed237b4dea4778bd5acab2b1c668b4/users/17cc2c85f2254d3f9b82c2916ef6f61b/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:36:07.690993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f2b8-3124-4258-926d-bdf61b755ee9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:07.691287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f2b8-3124-4258-926d-bdf61b755ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:07.691567 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f2b8-3124-4258-926d-bdf61b755ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:07.734692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-42f3f2b8-3124-4258-926d-bdf61b755ee9 None None] MFA Rules not processed for user `17cc2c85f2254d3f9b82c2916ef6f61b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:07.736852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-42f3f2b8-3124-4258-926d-bdf61b755ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:07.816461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1119/2263] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:07.830564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf99c3-095f-4eac-94e9-c3b1190417d6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:07.832928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-07cf99c3-095f-4eac-94e9-c3b1190417d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:07.919395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf99c3-095f-4eac-94e9-c3b1190417d6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:07.923706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290785f-6464-4d34-8fc6-19184f539494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:07.924765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290785f-6464-4d34-8fc6-19184f539494 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:07.925280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290785f-6464-4d34-8fc6-19184f539494 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:07.925800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290785f-6464-4d34-8fc6-19184f539494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:07.937091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290785f-6464-4d34-8fc6-19184f539494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:07.940163 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290785f-6464-4d34-8fc6-19184f539494 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:07.980633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1145/2264] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:36:09.541384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4be177-8185-4cf9-a405-6078abae0c27 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:09.541859 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4be177-8185-4cf9-a405-6078abae0c27 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:09.542257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4be177-8185-4cf9-a405-6078abae0c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:09.577829 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-be4be177-8185-4cf9-a405-6078abae0c27 None None] MFA Rules not processed for user `861dae3b1620455a9e55eebbce30a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:09.581025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-be4be177-8185-4cf9-a405-6078abae0c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:09.594168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:09.688527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1120/2265] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:09.819279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290785f-6464-4d34-8fc6-19184f539494 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:09.822516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3290785f-6464-4d34-8fc6-19184f539494 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:09.941736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290785f-6464-4d34-8fc6-19184f539494 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:09.947278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa93510-f227-444b-afad-6fa80621cde7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:09.947892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa93510-f227-444b-afad-6fa80621cde7 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:09.948175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa93510-f227-444b-afad-6fa80621cde7 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:09.948626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa93510-f227-444b-afad-6fa80621cde7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:09.950431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0fa93510-f227-444b-afad-6fa80621cde7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:09.973902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:10.017515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa93510-f227-444b-afad-6fa80621cde7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:10.019101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa93510-f227-444b-afad-6fa80621cde7 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:10.030498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1146/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:36:10.928447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4be177-8185-4cf9-a405-6078abae0c27 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:10.980186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf8b61-d249-4146-8778-2fdd4c020417 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:10.980652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf8b61-d249-4146-8778-2fdd4c020417 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:10.980760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf8b61-d249-4146-8778-2fdd4c020417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:11.014820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-68bf8b61-d249-4146-8778-2fdd4c020417 None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:11.016398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-68bf8b61-d249-4146-8778-2fdd4c020417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:11.035654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4be177-8185-4cf9-a405-6078abae0c27 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:11.041366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:11.042175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:11.042503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:11.042784 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] PATH_INFO: `/v3/users/17cc2c85f2254d3f9b82c2916ef6f61b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:11.043995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=17cc2c85f2254d3f9b82c2916ef6f61b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:11.046641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:11.090647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1147/2267] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:11.105362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf8b61-d249-4146-8778-2fdd4c020417 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:11.106776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-68bf8b61-d249-4146-8778-2fdd4c020417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:11.112165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17cc2c85f2254d3f9b82c2916ef6f61b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:11.124153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17cc2c85f2254d3f9b82c2916ef6f61b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:11.125029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17cc2c85f2254d3f9b82c2916ef6f61b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:11.134568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17cc2c85f2254d3f9b82c2916ef6f61b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:11.151298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-d9acf564-e90b-412a-a834-5da52a6ce6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17cc2c85f2254d3f9b82c2916ef6f61b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:11.165062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1121/2268] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:36:10 2022] DELETE /identity/v3/users/17cc2c85f2254d3f9b82c2916ef6f61b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:11.178363 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78bb19-4cc6-4d78-b40a-07274a95471e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:11.178858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78bb19-4cc6-4d78-b40a-07274a95471e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:11.179328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78bb19-4cc6-4d78-b40a-07274a95471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:11.204649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bb78bb19-4cc6-4d78-b40a-07274a95471e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:11.212061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bb78bb19-4cc6-4d78-b40a-07274a95471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:11.218094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf8b61-d249-4146-8778-2fdd4c020417 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:11.238752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:11.314520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1122/2269] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:11.325240 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78bb19-4cc6-4d78-b40a-07274a95471e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:11.327690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bb78bb19-4cc6-4d78-b40a-07274a95471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:11.359518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64ef73-bbc3-4443-9308-5b65a9b0816f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:11.360352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64ef73-bbc3-4443-9308-5b65a9b0816f service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:11.360705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64ef73-bbc3-4443-9308-5b65a9b0816f service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:11.361077 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64ef73-bbc3-4443-9308-5b65a9b0816f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:11.367932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4e64ef73-bbc3-4443-9308-5b65a9b0816f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:11.380689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:11.420807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78bb19-4cc6-4d78-b40a-07274a95471e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:11.424485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887ff9c-35ff-4e46-b49e-b5981186f38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:11.425130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ff9c-35ff-4e46-b49e-b5981186f38b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:11.425408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ff9c-35ff-4e46-b49e-b5981186f38b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:11.425668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887ff9c-35ff-4e46-b49e-b5981186f38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:11.436604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887ff9c-35ff-4e46-b49e-b5981186f38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:11.438074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887ff9c-35ff-4e46-b49e-b5981186f38b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:11.449758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64ef73-bbc3-4443-9308-5b65a9b0816f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:11.460912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1123/2270] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:36:11.462510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5956-c82d-4d6d-bb20-9ca0598e3f53 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:11.462799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5956-c82d-4d6d-bb20-9ca0598e3f53 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:11.463070 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5956-c82d-4d6d-bb20-9ca0598e3f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:11.465879 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64ef73-bbc3-4443-9308-5b65a9b0816f service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:11.478065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1148/2271] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:36:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 10:36:11.524205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7bbd5956-c82d-4d6d-bb20-9ca0598e3f53 None None] MFA Rules not processed for user `36b04859aac64e9e9157e1188c1b224c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:11.525467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7bbd5956-c82d-4d6d-bb20-9ca0598e3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:11.623082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1124/2272] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:11.921320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64ef73-bbc3-4443-9308-5b65a9b0816f service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:11.922865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4e64ef73-bbc3-4443-9308-5b65a9b0816f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:11.939048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64ef73-bbc3-4443-9308-5b65a9b0816f service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:11.960317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:11.961001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:11.961289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:11.961659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] PATH_INFO: `/v3/projects/90ed237b4dea4778bd5acab2b1c668b4` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:11.962842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ed237b4dea4778bd5acab2b1c668b4)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:11.964917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:12.033859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ed237b4dea4778bd5acab2b1c668b4', 'request_id': 'req-94076110-96a1-46b0-9aca-8ecfb0245275'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:12.043291 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ed237b4dea4778bd5acab2b1c668b4', 'request_id': 'req-94076110-96a1-46b0-9aca-8ecfb0245275'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:12.086996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ed237b4dea4778bd5acab2b1c668b4', 'request_id': 'req-94076110-96a1-46b0-9aca-8ecfb0245275'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:12.134060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] The token cache is being invalidate because project 90ed237b4dea4778bd5acab2b1c668b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:36:12.134417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:12.135219 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-94076110-96a1-46b0-9aca-8ecfb0245275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:12.137396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1149/2273] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:36:11 2022] DELETE /identity/v3/projects/90ed237b4dea4778bd5acab2b1c668b4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:12.142916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a668879-dc12-412f-8665-ec21e6b37d78 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:12.143782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a668879-dc12-412f-8665-ec21e6b37d78 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:12.144204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a668879-dc12-412f-8665-ec21e6b37d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:12.178268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0a668879-dc12-412f-8665-ec21e6b37d78 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:12.180006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0a668879-dc12-412f-8665-ec21e6b37d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:12.337939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1125/2274] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:12.346912 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f9d93-c8dc-4938-8d60-3dabf67660ef None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:12.347194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f9d93-c8dc-4938-8d60-3dabf67660ef None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:12.347473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f9d93-c8dc-4938-8d60-3dabf67660ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:12.413396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-143f9d93-c8dc-4938-8d60-3dabf67660ef None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:12.414547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-143f9d93-c8dc-4938-8d60-3dabf67660ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:12.436089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1150/2275] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:12.447737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a668879-dc12-412f-8665-ec21e6b37d78 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:12.465641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a668879-dc12-412f-8665-ec21e6b37d78 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:12.481847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6c91-73de-4e61-ad07-698bed954245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:12.482525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6c91-73de-4e61-ad07-698bed954245 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:12.482801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6c91-73de-4e61-ad07-698bed954245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:12.483071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6c91-73de-4e61-ad07-698bed954245 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:12.483792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6c91-73de-4e61-ad07-698bed954245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:36:12.484134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6c91-73de-4e61-ad07-698bed954245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:12.488800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6c91-73de-4e61-ad07-698bed954245 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:12.508653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:12.519444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1126/2276] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:36:12.523865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f9d93-c8dc-4938-8d60-3dabf67660ef None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:12.543662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f9d93-c8dc-4938-8d60-3dabf67660ef None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:12.552452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b743d1-b6f9-414c-909b-f6a0a0fd014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:12.553103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b743d1-b6f9-414c-909b-f6a0a0fd014e admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:12.553384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b743d1-b6f9-414c-909b-f6a0a0fd014e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:12.553657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b743d1-b6f9-414c-909b-f6a0a0fd014e admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:12.554292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b743d1-b6f9-414c-909b-f6a0a0fd014e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:12.556192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b743d1-b6f9-414c-909b-f6a0a0fd014e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:12.616680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6c91-73de-4e61-ad07-698bed954245 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:12.618648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1151/2277] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:36:12 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:36:12.651372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6c91-73de-4e61-ad07-698bed954245 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:12.738795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02c3dd-4d7d-4525-b805-dc3b9757ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:12.747026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02c3dd-4d7d-4525-b805-dc3b9757ba73 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:12.747408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02c3dd-4d7d-4525-b805-dc3b9757ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:12.748106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02c3dd-4d7d-4525-b805-dc3b9757ba73 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:12.748765 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02c3dd-4d7d-4525-b805-dc3b9757ba73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:12.750764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02c3dd-4d7d-4525-b805-dc3b9757ba73 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:12.801235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1127/2278] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:36:12 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:36:12.802873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b743d1-b6f9-414c-909b-f6a0a0fd014e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:12.823097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b743d1-b6f9-414c-909b-f6a0a0fd014e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:12.834236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b459-6d70-4377-9e38-0d7e00fdeff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:12.835235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b459-6d70-4377-9e38-0d7e00fdeff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:12.836977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b459-6d70-4377-9e38-0d7e00fdeff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:12.851460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b459-6d70-4377-9e38-0d7e00fdeff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:12.852433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19b459-6d70-4377-9e38-0d7e00fdeff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:12.859110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19b459-6d70-4377-9e38-0d7e00fdeff6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:12.899408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1152/2279] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:36:12.903339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02c3dd-4d7d-4525-b805-dc3b9757ba73 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:12.922648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02c3dd-4d7d-4525-b805-dc3b9757ba73 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:12.930325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f71437-9f2c-4eb2-89c8-ccf31445acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:12.931370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f71437-9f2c-4eb2-89c8-ccf31445acb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:12.933983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f71437-9f2c-4eb2-89c8-ccf31445acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:12.934960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f71437-9f2c-4eb2-89c8-ccf31445acb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:12.937107 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f71437-9f2c-4eb2-89c8-ccf31445acb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:12.939054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f71437-9f2c-4eb2-89c8-ccf31445acb1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:12.957552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1128/2280] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:36:12.958739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b459-6d70-4377-9e38-0d7e00fdeff6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:12.970791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b459-6d70-4377-9e38-0d7e00fdeff6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:12.997845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18638-0d80-422b-bf8e-35fb46b8936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:12.998546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18638-0d80-422b-bf8e-35fb46b8936d admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:12.998811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18638-0d80-422b-bf8e-35fb46b8936d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:12.999138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18638-0d80-422b-bf8e-35fb46b8936d admin admin] PATH_INFO: `/v3/projects/52e55a8effce4a27b03a73b2c604903f/users/94c96aa490d84825a41569bc75e63f5e/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:13.033514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab18638-0d80-422b-bf8e-35fb46b8936d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e55a8effce4a27b03a73b2c604903f, user_id=94c96aa490d84825a41569bc75e63f5e, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:13.036476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab18638-0d80-422b-bf8e-35fb46b8936d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:13.088737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b93449-6bc3-4b3e-99c3-c6fa068f519f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:13.089107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1153/2281] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:36:12 2022] PUT /identity/v3/projects/52e55a8effce4a27b03a73b2c604903f/users/94c96aa490d84825a41569bc75e63f5e/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:13.089290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b93449-6bc3-4b3e-99c3-c6fa068f519f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:13.089453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b93449-6bc3-4b3e-99c3-c6fa068f519f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:13.148542 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a9b93449-6bc3-4b3e-99c3-c6fa068f519f None None] MFA Rules not processed for user `94c96aa490d84825a41569bc75e63f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:13.150716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a9b93449-6bc3-4b3e-99c3-c6fa068f519f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:13.303253 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1129/2282] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:13.317860 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18638-0d80-422b-bf8e-35fb46b8936d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:13.320108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3ab18638-0d80-422b-bf8e-35fb46b8936d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:13.397176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:13.468248 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18638-0d80-422b-bf8e-35fb46b8936d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:13.487819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0e2e5-817c-4aa9-b03e-c689a3a87296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:13.489766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0e2e5-817c-4aa9-b03e-c689a3a87296 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:13.492460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0e2e5-817c-4aa9-b03e-c689a3a87296 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:13.494862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0e2e5-817c-4aa9-b03e-c689a3a87296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:13.527460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0e2e5-817c-4aa9-b03e-c689a3a87296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:13.529660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0e2e5-817c-4aa9-b03e-c689a3a87296 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:13.558873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1154/2283] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:36:13.613472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b93449-6bc3-4b3e-99c3-c6fa068f519f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:13.734514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b93449-6bc3-4b3e-99c3-c6fa068f519f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:13.740113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:13.740752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:13.741063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:13.741339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] PATH_INFO: `/v3/users/94c96aa490d84825a41569bc75e63f5e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:13.742766 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c96aa490d84825a41569bc75e63f5e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:13.745019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:13.771351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:13.845632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c96aa490d84825a41569bc75e63f5e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:13.858582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c96aa490d84825a41569bc75e63f5e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:13.859245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c96aa490d84825a41569bc75e63f5e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:13.873116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c96aa490d84825a41569bc75e63f5e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:13.906727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c96aa490d84825a41569bc75e63f5e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:13.926467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1abf4-8cde-42f8-bfa5-df98ff0ec52a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:13.926822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1abf4-8cde-42f8-bfa5-df98ff0ec52a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:13.927011 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1abf4-8cde-42f8-bfa5-df98ff0ec52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:13.930043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1130/2284] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:36:13 2022] DELETE /identity/v3/users/94c96aa490d84825a41569bc75e63f5e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:13.955672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-daa1abf4-8cde-42f8-bfa5-df98ff0ec52a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:13.958701 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-daa1abf4-8cde-42f8-bfa5-df98ff0ec52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:14.097478 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1155/2285] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:14.126924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:14.128473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:14.281642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352b72a-c16a-4583-a716-4f284301198a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:14.286390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd049-6485-4eb5-b4ec-eaf806424a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:14.287585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd049-6485-4eb5-b4ec-eaf806424a46 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:14.287777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd049-6485-4eb5-b4ec-eaf806424a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:14.288052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd049-6485-4eb5-b4ec-eaf806424a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:14.304568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd049-6485-4eb5-b4ec-eaf806424a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:14.307083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd049-6485-4eb5-b4ec-eaf806424a46 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:14.409409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1131/2286] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:36:14.986305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1abf4-8cde-42f8-bfa5-df98ff0ec52a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:14.987970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-daa1abf4-8cde-42f8-bfa5-df98ff0ec52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:15.005839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1abf4-8cde-42f8-bfa5-df98ff0ec52a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:15.012782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:15.013718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:15.014262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:15.015271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] PATH_INFO: `/v3/projects/52e55a8effce4a27b03a73b2c604903f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:15.016753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e55a8effce4a27b03a73b2c604903f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:15.018992 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:15.097943 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e55a8effce4a27b03a73b2c604903f', 'request_id': 'req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:15.111947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e55a8effce4a27b03a73b2c604903f', 'request_id': 'req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:15.119795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e55a8effce4a27b03a73b2c604903f', 'request_id': 'req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:15.139634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] The token cache is being invalidate because project 52e55a8effce4a27b03a73b2c604903f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:36:15.140121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:15.141065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a5f883cf-e43f-4e86-893d-7b8f5ec1aefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:15.146703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1156/2287] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:36:14 2022] DELETE /identity/v3/projects/52e55a8effce4a27b03a73b2c604903f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:15.147862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf638bc-20fc-4729-993c-34cf16b8b4ff None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:15.148151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf638bc-20fc-4729-993c-34cf16b8b4ff None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:15.148424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf638bc-20fc-4729-993c-34cf16b8b4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:15.178096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-daf638bc-20fc-4729-993c-34cf16b8b4ff None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:15.179301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-daf638bc-20fc-4729-993c-34cf16b8b4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:15.325695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1132/2288] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:36:15.334026 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6044279-a48c-4728-9ac7-2ba2f00f2b1b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:15.334312 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6044279-a48c-4728-9ac7-2ba2f00f2b1b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:15.334588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6044279-a48c-4728-9ac7-2ba2f00f2b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:15.368453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b6044279-a48c-4728-9ac7-2ba2f00f2b1b None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:15.370340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b6044279-a48c-4728-9ac7-2ba2f00f2b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:15.390862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1157/2289] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:36:15.395256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf638bc-20fc-4729-993c-34cf16b8b4ff None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:15.410313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf638bc-20fc-4729-993c-34cf16b8b4ff None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:15.424066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59464-de40-4a09-be76-4fa0b2ae66ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:15.424845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59464-de40-4a09-be76-4fa0b2ae66ad admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:15.425251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59464-de40-4a09-be76-4fa0b2ae66ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:15.425619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59464-de40-4a09-be76-4fa0b2ae66ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:15.428397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59464-de40-4a09-be76-4fa0b2ae66ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:36:15.428831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59464-de40-4a09-be76-4fa0b2ae66ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:15.434437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59464-de40-4a09-be76-4fa0b2ae66ad admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:15.463136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1133/2290] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:36:15.468339 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6044279-a48c-4728-9ac7-2ba2f00f2b1b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:15.479232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6044279-a48c-4728-9ac7-2ba2f00f2b1b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:15.487734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0462d-ee48-4361-b4f1-c7d5b714b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:15.488653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0462d-ee48-4361-b4f1-c7d5b714b0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:15.489647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0462d-ee48-4361-b4f1-c7d5b714b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:15.490531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0462d-ee48-4361-b4f1-c7d5b714b0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:15.492226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0462d-ee48-4361-b4f1-c7d5b714b0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:15.495083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0462d-ee48-4361-b4f1-c7d5b714b0f6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:15.549010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1158/2291] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:36:15 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:36:15.551140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59464-de40-4a09-be76-4fa0b2ae66ad admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:15.564400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59464-de40-4a09-be76-4fa0b2ae66ad admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:15.600739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:15.690853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03226b8-dde3-4ae6-99c5-2a1394807746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:15.691640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03226b8-dde3-4ae6-99c5-2a1394807746 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:15.692010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03226b8-dde3-4ae6-99c5-2a1394807746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:15.692359 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03226b8-dde3-4ae6-99c5-2a1394807746 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:15.693102 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03226b8-dde3-4ae6-99c5-2a1394807746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:15.695267 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03226b8-dde3-4ae6-99c5-2a1394807746 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:15.736773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1134/2292] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:36:15 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:36:15.741308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0462d-ee48-4361-b4f1-c7d5b714b0f6 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:15.763213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0462d-ee48-4361-b4f1-c7d5b714b0f6 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:15.771597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ad9c4-a517-4953-908f-70e79440e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:15.772856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad9c4-a517-4953-908f-70e79440e7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:15.773811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad9c4-a517-4953-908f-70e79440e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:15.774199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad9c4-a517-4953-908f-70e79440e7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:15.775010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ad9c4-a517-4953-908f-70e79440e7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:15.777154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ad9c4-a517-4953-908f-70e79440e7c5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:15.792668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1159/2293] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:36:15.796587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03226b8-dde3-4ae6-99c5-2a1394807746 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:15.814703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03226b8-dde3-4ae6-99c5-2a1394807746 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:15.821445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19878b00-00df-4d1a-9e20-10c7fdc9a8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:15.821978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19878b00-00df-4d1a-9e20-10c7fdc9a8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:15.822257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19878b00-00df-4d1a-9e20-10c7fdc9a8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:15.822534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19878b00-00df-4d1a-9e20-10c7fdc9a8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:15.823194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19878b00-00df-4d1a-9e20-10c7fdc9a8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:15.825157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19878b00-00df-4d1a-9e20-10c7fdc9a8f0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:15.853482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1135/2294] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:36:15.854203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ad9c4-a517-4953-908f-70e79440e7c5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:15.864993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ad9c4-a517-4953-908f-70e79440e7c5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:15.870950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d45f8-54d5-47d1-bf9e-7cd18c318fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:15.871726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d45f8-54d5-47d1-bf9e-7cd18c318fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:15.871933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d45f8-54d5-47d1-bf9e-7cd18c318fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:15.872211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d45f8-54d5-47d1-bf9e-7cd18c318fd7 admin admin] PATH_INFO: `/v3/projects/d9fcc4ee0f1b4da3a894d5ff5db8ffb8/users/1b0a1c15c63c483bad2528b552dbba64/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:15.886062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:15.890772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d45f8-54d5-47d1-bf9e-7cd18c318fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fcc4ee0f1b4da3a894d5ff5db8ffb8, user_id=1b0a1c15c63c483bad2528b552dbba64, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:15.894138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d45f8-54d5-47d1-bf9e-7cd18c318fd7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:15.910968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1160/2295] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:36:15 2022] PUT /identity/v3/projects/d9fcc4ee0f1b4da3a894d5ff5db8ffb8/users/1b0a1c15c63c483bad2528b552dbba64/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:36:15.922290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bec002-4d77-4086-8ee2-958da81b86ef None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:15.922580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bec002-4d77-4086-8ee2-958da81b86ef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:15.922890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bec002-4d77-4086-8ee2-958da81b86ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:15.958467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-62bec002-4d77-4086-8ee2-958da81b86ef None None] MFA Rules not processed for user `1b0a1c15c63c483bad2528b552dbba64`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:15.959696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-62bec002-4d77-4086-8ee2-958da81b86ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:16.040172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1136/2296] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:16.051106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d45f8-54d5-47d1-bf9e-7cd18c318fd7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:16.053148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5b7d45f8-54d5-47d1-bf9e-7cd18c318fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:16.133071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d45f8-54d5-47d1-bf9e-7cd18c318fd7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:16.137097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894d7e-2d0a-4598-88b0-ae0ba27cfbcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:16.137725 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894d7e-2d0a-4598-88b0-ae0ba27cfbcf service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:16.138048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894d7e-2d0a-4598-88b0-ae0ba27cfbcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:16.138388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894d7e-2d0a-4598-88b0-ae0ba27cfbcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:16.152668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894d7e-2d0a-4598-88b0-ae0ba27cfbcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:16.154216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11894d7e-2d0a-4598-88b0-ae0ba27cfbcf service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:16.164441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1161/2297] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:36:26.035157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:26.160493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:28.114756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bec002-4d77-4086-8ee2-958da81b86ef None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:28.179727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bec002-4d77-4086-8ee2-958da81b86ef None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:28.184755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:28.185967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:28.186357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:28.186701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] PATH_INFO: `/v3/users/1b0a1c15c63c483bad2528b552dbba64` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:28.188303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0a1c15c63c483bad2528b552dbba64)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:28.190678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:28.242708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0a1c15c63c483bad2528b552dbba64'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:28.250682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0a1c15c63c483bad2528b552dbba64'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:28.251375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0a1c15c63c483bad2528b552dbba64'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:28.258161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0a1c15c63c483bad2528b552dbba64'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:28.271131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0a1c15c63c483bad2528b552dbba64'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:28.276905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1137/2298] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:36:28 2022] DELETE /identity/v3/users/1b0a1c15c63c483bad2528b552dbba64 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:28.281416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d728d4-2c3a-4505-9bb9-92018d28c500 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:28.281914 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d728d4-2c3a-4505-9bb9-92018d28c500 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:28.282017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d728d4-2c3a-4505-9bb9-92018d28c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:28.300657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b7d728d4-2c3a-4505-9bb9-92018d28c500 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:28.301869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b7d728d4-2c3a-4505-9bb9-92018d28c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:28.317858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:28.319224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:28.370509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1162/2299] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:28.381524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d728d4-2c3a-4505-9bb9-92018d28c500 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:28.382870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b7d728d4-2c3a-4505-9bb9-92018d28c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:28.390296 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238353a-cb00-4085-9e7d-e4422efff658 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:28.395476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f681e4-6baf-41a8-a68b-76c5fa04f206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:28.396199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f681e4-6baf-41a8-a68b-76c5fa04f206 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:28.396387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f681e4-6baf-41a8-a68b-76c5fa04f206 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:28.396630 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f681e4-6baf-41a8-a68b-76c5fa04f206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:28.398411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-19f681e4-6baf-41a8-a68b-76c5fa04f206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:28.410236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f681e4-6baf-41a8-a68b-76c5fa04f206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:28.411836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f681e4-6baf-41a8-a68b-76c5fa04f206 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:28.422899 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1138/2300] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:36:28.442242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d728d4-2c3a-4505-9bb9-92018d28c500 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:28.448247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c666e3-3260-490c-b7d9-74a6ee8eaa16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:28.448857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c666e3-3260-490c-b7d9-74a6ee8eaa16 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:28.449168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c666e3-3260-490c-b7d9-74a6ee8eaa16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:28.449443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c666e3-3260-490c-b7d9-74a6ee8eaa16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:28.459933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c666e3-3260-490c-b7d9-74a6ee8eaa16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:28.461391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c666e3-3260-490c-b7d9-74a6ee8eaa16 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:28.471934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1163/2301] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:36:28.771247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f681e4-6baf-41a8-a68b-76c5fa04f206 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:28.772781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-19f681e4-6baf-41a8-a68b-76c5fa04f206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:28.793100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f681e4-6baf-41a8-a68b-76c5fa04f206 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:28.799864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:28.800581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:28.800868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:28.801153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] PATH_INFO: `/v3/projects/d9fcc4ee0f1b4da3a894d5ff5db8ffb8` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:28.802282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9fcc4ee0f1b4da3a894d5ff5db8ffb8)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:28.804143 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:28.807348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:28.862066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9fcc4ee0f1b4da3a894d5ff5db8ffb8', 'request_id': 'req-6ce72c5d-68bf-4d6f-91da-07c89a55c490'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:28.870462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9fcc4ee0f1b4da3a894d5ff5db8ffb8', 'request_id': 'req-6ce72c5d-68bf-4d6f-91da-07c89a55c490'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:28.881110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9fcc4ee0f1b4da3a894d5ff5db8ffb8', 'request_id': 'req-6ce72c5d-68bf-4d6f-91da-07c89a55c490'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:28.901903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] The token cache is being invalidate because project d9fcc4ee0f1b4da3a894d5ff5db8ffb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:36:28.902225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:28.902854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ce72c5d-68bf-4d6f-91da-07c89a55c490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:36:28.905228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1139/2302] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:36:28 2022] DELETE /identity/v3/projects/d9fcc4ee0f1b4da3a894d5ff5db8ffb8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:36:29.540030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeab5e-7b19-4a3f-8d0d-d65c1a6e0bba None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:29.540569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeab5e-7b19-4a3f-8d0d-d65c1a6e0bba None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:29.540676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeab5e-7b19-4a3f-8d0d-d65c1a6e0bba None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:29.542125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1164/2303] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:36:29.548236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786b55-f17b-4ecf-9a9c-3fa07ebb8897 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:29.548695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786b55-f17b-4ecf-9a9c-3fa07ebb8897 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:29.548790 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d786b55-f17b-4ecf-9a9c-3fa07ebb8897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:29.574318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8d786b55-f17b-4ecf-9a9c-3fa07ebb8897 None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:29.575600 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8d786b55-f17b-4ecf-9a9c-3fa07ebb8897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:29.644093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1140/2304] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:36:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:29.656507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeab5e-7b19-4a3f-8d0d-d65c1a6e0bba None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:29.658323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8beeab5e-7b19-4a3f-8d0d-d65c1a6e0bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:29.715488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeab5e-7b19-4a3f-8d0d-d65c1a6e0bba None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:29.719441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa5d66-09b9-4f38-a4f6-61af0c1c1a56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfef506919f4914a7883bd99ea07615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:29.720025 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa5d66-09b9-4f38-a4f6-61af0c1c1a56 service glance] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:29.720299 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa5d66-09b9-4f38-a4f6-61af0c1c1a56 service glance] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:29.720567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa5d66-09b9-4f38-a4f6-61af0c1c1a56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:29.730696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa5d66-09b9-4f38-a4f6-61af0c1c1a56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:29.732156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa5d66-09b9-4f38-a4f6-61af0c1c1a56 service glance] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:29.743175 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1165/2305] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:36:29.810579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f2eab-9936-4e90-8a66-86b5270862f3 None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:29.810889 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f2eab-9936-4e90-8a66-86b5270862f3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:29.811166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f2eab-9936-4e90-8a66-86b5270862f3 None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:29.812497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1141/2306] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:36:29.817152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70d829-27ca-42cd-82aa-7bc625a48559 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:29.817436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70d829-27ca-42cd-82aa-7bc625a48559 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:29.817707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70d829-27ca-42cd-82aa-7bc625a48559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:29.837680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ac70d829-27ca-42cd-82aa-7bc625a48559 None None] MFA Rules not processed for user `ad0f25125b534983af66d5326f4d626d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:29.838872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ac70d829-27ca-42cd-82aa-7bc625a48559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:29.883363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:29.894014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1166/2307] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:36:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:29.906883 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f2eab-9936-4e90-8a66-86b5270862f3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:29.908564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ad2f2eab-9936-4e90-8a66-86b5270862f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:29.921332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f2eab-9936-4e90-8a66-86b5270862f3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:29.924797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94691f1-2838-4244-88a5-e77ec2bd4b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:29.925406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94691f1-2838-4244-88a5-e77ec2bd4b67 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:29.925682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94691f1-2838-4244-88a5-e77ec2bd4b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:29.925952 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94691f1-2838-4244-88a5-e77ec2bd4b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:29.932970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94691f1-2838-4244-88a5-e77ec2bd4b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:29.934705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94691f1-2838-4244-88a5-e77ec2bd4b67 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:29.942166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1142/2308] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:36:30.023514 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3b6d-ebba-45ef-a0b5-5b93f374f4d6 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:30.023802 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3b6d-ebba-45ef-a0b5-5b93f374f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:30.024080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3b6d-ebba-45ef-a0b5-5b93f374f4d6 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:30.025517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1167/2309] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:36:30.030269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237821eb-fc51-471c-a59f-4f67a2a938c4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:30.030559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237821eb-fc51-471c-a59f-4f67a2a938c4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:30.030837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237821eb-fc51-471c-a59f-4f67a2a938c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:30.050667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-237821eb-fc51-471c-a59f-4f67a2a938c4 None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:30.051858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-237821eb-fc51-471c-a59f-4f67a2a938c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:30.061690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1143/2310] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:36:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:30.072113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e3b6d-ebba-45ef-a0b5-5b93f374f4d6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:30.083090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e3b6d-ebba-45ef-a0b5-5b93f374f4d6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:30.086617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1831a-ae93-4a64-9766-b37bc4604003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:30.087207 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1831a-ae93-4a64-9766-b37bc4604003 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:30.087491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1831a-ae93-4a64-9766-b37bc4604003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:30.087760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1831a-ae93-4a64-9766-b37bc4604003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:30.097691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1831a-ae93-4a64-9766-b37bc4604003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:30.099121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1831a-ae93-4a64-9766-b37bc4604003 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:30.110131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1168/2311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:36:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:36:32.782718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97559b3-ef0f-41b4-b568-2a9fb20977af None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:32.783204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97559b3-ef0f-41b4-b568-2a9fb20977af None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:32.783301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97559b3-ef0f-41b4-b568-2a9fb20977af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:32.802141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-c97559b3-ef0f-41b4-b568-2a9fb20977af None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:36:32.803313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c97559b3-ef0f-41b4-b568-2a9fb20977af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:32.855921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1144/2312] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:36:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:36:32.878559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1831a-ae93-4a64-9766-b37bc4604003 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:36:32.880086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-74f1831a-ae93-4a64-9766-b37bc4604003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:36:32.947086 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1831a-ae93-4a64-9766-b37bc4604003 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:36:32.951976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27292934-9ae1-4346-a913-ddfc1e051896 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:36:32.952565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27292934-9ae1-4346-a913-ddfc1e051896 service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:36:32.952842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27292934-9ae1-4346-a913-ddfc1e051896 service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:36:32.953146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27292934-9ae1-4346-a913-ddfc1e051896 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:36:32.961141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27292934-9ae1-4346-a913-ddfc1e051896 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:36:32.962684 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27292934-9ae1-4346-a913-ddfc1e051896 service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:36:32.970447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1169/2313] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:36:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:36:42.849035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:42.967358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=40 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:02.812047 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa3b18-22fe-4122-a633-e3b5007c6996 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:37:02.812555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa3b18-22fe-4122-a633-e3b5007c6996 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:37:02.812705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa3b18-22fe-4122-a633-e3b5007c6996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:37:02.833677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-44fa3b18-22fe-4122-a633-e3b5007c6996 None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:37:02.834871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-44fa3b18-22fe-4122-a633-e3b5007c6996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:37:02.841876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1145/2314] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 10:37:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:37:02.854650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27292934-9ae1-4346-a913-ddfc1e051896 service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:37:02.865012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27292934-9ae1-4346-a913-ddfc1e051896 service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:37:02.869971 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f311edc-659e-4762-bdeb-df3c7e23ee1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:37:02.870497 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f311edc-659e-4762-bdeb-df3c7e23ee1d service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:37:02.870775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f311edc-659e-4762-bdeb-df3c7e23ee1d service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:37:02.871045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f311edc-659e-4762-bdeb-df3c7e23ee1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:37:02.879268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f311edc-659e-4762-bdeb-df3c7e23ee1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:37:02.880811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f311edc-659e-4762-bdeb-df3c7e23ee1d service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:37:02.888474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1170/2315] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:37:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:37:07.606762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa3b18-22fe-4122-a633-e3b5007c6996 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:37:07.608161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-44fa3b18-22fe-4122-a633-e3b5007c6996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:37:07.619922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa3b18-22fe-4122-a633-e3b5007c6996 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:37:07.623456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71d853-761d-4c36-b1d4-86d428d2da90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:37:07.624563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d853-761d-4c36-b1d4-86d428d2da90 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:37:07.624841 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d853-761d-4c36-b1d4-86d428d2da90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:37:07.625144 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d853-761d-4c36-b1d4-86d428d2da90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:37:07.626786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5b71d853-761d-4c36-b1d4-86d428d2da90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:37:07.691292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71d853-761d-4c36-b1d4-86d428d2da90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:37:07.692723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71d853-761d-4c36-b1d4-86d428d2da90 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:37:07.702248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1146/2316] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:37:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:37:12.885490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:17.697952 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=33 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:31.967805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef86a7-8258-4be0-9d32-dd4a23c7e665 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:37:31.968417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef86a7-8258-4be0-9d32-dd4a23c7e665 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:37:31.968530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef86a7-8258-4be0-9d32-dd4a23c7e665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:37:31.987800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d1ef86a7-8258-4be0-9d32-dd4a23c7e665 None None] MFA Rules not processed for user `79deff91d5c046c4bbe7b2e47b21ba66`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:37:31.989021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d1ef86a7-8258-4be0-9d32-dd4a23c7e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:37:32.043765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1171/2317] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:37:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:37:42.037018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=25 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:47.305142 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71d853-761d-4c36-b1d4-86d428d2da90 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:37:47.306576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5b71d853-761d-4c36-b1d4-86d428d2da90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:37:47.364350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71d853-761d-4c36-b1d4-86d428d2da90 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:37:47.367890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4559c-a4a4-4778-89e9-45787febccb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:37:47.368527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4559c-a4a4-4778-89e9-45787febccb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:37:47.368805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4559c-a4a4-4778-89e9-45787febccb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:37:47.369109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4559c-a4a4-4778-89e9-45787febccb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:37:47.370900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-88c4559c-a4a4-4778-89e9-45787febccb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:37:47.384219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4559c-a4a4-4778-89e9-45787febccb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:37:47.385963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4559c-a4a4-4778-89e9-45787febccb7 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:37:47.397004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1147/2318] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:37:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:37:48.872581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef86a7-8258-4be0-9d32-dd4a23c7e665 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:37:48.882414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef86a7-8258-4be0-9d32-dd4a23c7e665 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:37:48.885937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a63a-bfb3-4da1-a0f7-c4cf973cbb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:37:48.886522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a63a-bfb3-4da1-a0f7-c4cf973cbb55 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:37:48.886797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a63a-bfb3-4da1-a0f7-c4cf973cbb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:37:48.887064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5a63a-bfb3-4da1-a0f7-c4cf973cbb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:37:48.888727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8df5a63a-bfb3-4da1-a0f7-c4cf973cbb55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:37:48.902298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5a63a-bfb3-4da1-a0f7-c4cf973cbb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:37:48.903712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5a63a-bfb3-4da1-a0f7-c4cf973cbb55 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:37:48.914508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1172/2319] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:37:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:37:57.391878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=26 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:58.909821 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:01.421257 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4559c-a4a4-4778-89e9-45787febccb7 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:38:01.423303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-88c4559c-a4a4-4778-89e9-45787febccb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:01.436660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4559c-a4a4-4778-89e9-45787febccb7 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:38:01.442110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf6c81-8138-49ea-bbba-0d0a15c3eede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:38:01.442692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf6c81-8138-49ea-bbba-0d0a15c3eede service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:38:01.442969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf6c81-8138-49ea-bbba-0d0a15c3eede service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:38:01.443240 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf6c81-8138-49ea-bbba-0d0a15c3eede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:38:01.444860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-decf6c81-8138-49ea-bbba-0d0a15c3eede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:01.503412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf6c81-8138-49ea-bbba-0d0a15c3eede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:38:01.505170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf6c81-8138-49ea-bbba-0d0a15c3eede service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:38:01.514609 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1148/2320] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:38:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:38:03.071575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a63a-bfb3-4da1-a0f7-c4cf973cbb55 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:38:03.073076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8df5a63a-bfb3-4da1-a0f7-c4cf973cbb55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:03.086895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5a63a-bfb3-4da1-a0f7-c4cf973cbb55 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:38:03.092267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afd625-4ef8-457d-95ab-490c7059d9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:38:03.092851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd625-4ef8-457d-95ab-490c7059d9dc service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:38:03.093154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd625-4ef8-457d-95ab-490c7059d9dc service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:38:03.093423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd625-4ef8-457d-95ab-490c7059d9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:38:03.095537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-67afd625-4ef8-457d-95ab-490c7059d9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:03.153231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afd625-4ef8-457d-95ab-490c7059d9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:38:03.154780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afd625-4ef8-457d-95ab-490c7059d9dc service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:38:03.164163 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1173/2321] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:38:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:38:08.157752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caca41a-4801-4b3d-8a63-2996a7a7043e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:38:08.158252 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caca41a-4801-4b3d-8a63-2996a7a7043e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:38:08.158356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caca41a-4801-4b3d-8a63-2996a7a7043e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:38:08.177591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7caca41a-4801-4b3d-8a63-2996a7a7043e None None] MFA Rules not processed for user `85869eddd2924f85a318e77184c5607b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:38:08.178782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7caca41a-4801-4b3d-8a63-2996a7a7043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:08.185506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1149/2322] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:38:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:38:13.160068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=28 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:15.686726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afd625-4ef8-457d-95ab-490c7059d9dc service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:38:15.698221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afd625-4ef8-457d-95ab-490c7059d9dc service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:38:15.701896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98c410-693e-430c-a511-dde74b54719e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:38:15.702532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98c410-693e-430c-a511-dde74b54719e service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:38:15.702812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98c410-693e-430c-a511-dde74b54719e service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:38:15.703080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98c410-693e-430c-a511-dde74b54719e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:38:15.704853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4a98c410-693e-430c-a511-dde74b54719e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:15.715184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98c410-693e-430c-a511-dde74b54719e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:38:15.716627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98c410-693e-430c-a511-dde74b54719e service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:38:15.725482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1174/2323] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:38:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:38:18.171282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=31 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:24.435338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caca41a-4801-4b3d-8a63-2996a7a7043e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:38:24.448510 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caca41a-4801-4b3d-8a63-2996a7a7043e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:38:24.453967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40d5df-7ea2-4000-aab8-ec74b391fab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:38:24.454553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40d5df-7ea2-4000-aab8-ec74b391fab2 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:38:24.454833 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40d5df-7ea2-4000-aab8-ec74b391fab2 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:38:24.455109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40d5df-7ea2-4000-aab8-ec74b391fab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:38:24.456828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ec40d5df-7ea2-4000-aab8-ec74b391fab2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:24.514975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40d5df-7ea2-4000-aab8-ec74b391fab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:38:24.516579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40d5df-7ea2-4000-aab8-ec74b391fab2 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:38:24.525399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1150/2324] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:38:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:38:25.721816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:30.425136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98c410-693e-430c-a511-dde74b54719e service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:38:30.439192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98c410-693e-430c-a511-dde74b54719e service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:38:30.447081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e14d13-e0ca-4d81-ae36-5d09c3e2cb05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:38:30.447809 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e14d13-e0ca-4d81-ae36-5d09c3e2cb05 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:38:30.448185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e14d13-e0ca-4d81-ae36-5d09c3e2cb05 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:38:30.448519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e14d13-e0ca-4d81-ae36-5d09c3e2cb05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:38:30.450537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-37e14d13-e0ca-4d81-ae36-5d09c3e2cb05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:30.465457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e14d13-e0ca-4d81-ae36-5d09c3e2cb05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:38:30.467782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e14d13-e0ca-4d81-ae36-5d09c3e2cb05 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:38:30.479770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1175/2325] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:38:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:38:34.296304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993014-4370-4d99-ae4d-ddc2af877c7e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:38:34.296773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993014-4370-4d99-ae4d-ddc2af877c7e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:38:34.296888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993014-4370-4d99-ae4d-ddc2af877c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:38:34.316385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1e993014-4370-4d99-ae4d-ddc2af877c7e None None] MFA Rules not processed for user `e0589d6270464a4c8f5ed7680ca48164`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:38:34.317593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1e993014-4370-4d99-ae4d-ddc2af877c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:34.324218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1151/2326] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:38:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:38:34.625908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e14d13-e0ca-4d81-ae36-5d09c3e2cb05 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:38:34.634880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e14d13-e0ca-4d81-ae36-5d09c3e2cb05 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:38:34.638419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888b0af-9c40-4dee-bcd0-650a5c87db5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:38:34.639000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888b0af-9c40-4dee-bcd0-650a5c87db5c service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:38:34.639276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888b0af-9c40-4dee-bcd0-650a5c87db5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:38:34.639550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888b0af-9c40-4dee-bcd0-650a5c87db5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:38:34.641283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d888b0af-9c40-4dee-bcd0-650a5c87db5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:34.650293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888b0af-9c40-4dee-bcd0-650a5c87db5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:38:34.652010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888b0af-9c40-4dee-bcd0-650a5c87db5c service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:38:34.660065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1176/2327] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:38:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:38:34.978138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993014-4370-4d99-ae4d-ddc2af877c7e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:38:34.979689 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1e993014-4370-4d99-ae4d-ddc2af877c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:35.052316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993014-4370-4d99-ae4d-ddc2af877c7e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:38:35.057246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bfeb7-90c0-4ab8-958b-fae0b6cbbcc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:38:35.057846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bfeb7-90c0-4ab8-958b-fae0b6cbbcc8 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:38:35.058127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bfeb7-90c0-4ab8-958b-fae0b6cbbcc8 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:38:35.058398 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bfeb7-90c0-4ab8-958b-fae0b6cbbcc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:38:35.060082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fd8bfeb7-90c0-4ab8-958b-fae0b6cbbcc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:35.071224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bfeb7-90c0-4ab8-958b-fae0b6cbbcc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:38:35.072783 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bfeb7-90c0-4ab8-958b-fae0b6cbbcc8 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:38:35.083073 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1152/2328] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:38:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:38:44.656281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=12 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:44.839619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888b0af-9c40-4dee-bcd0-650a5c87db5c service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:38:44.855634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888b0af-9c40-4dee-bcd0-650a5c87db5c service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:38:44.861442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbebcf2-4a06-4191-b7d0-a4fc9d584731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:38:44.862056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbebcf2-4a06-4191-b7d0-a4fc9d584731 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:38:44.862369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbebcf2-4a06-4191-b7d0-a4fc9d584731 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:38:44.862652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbebcf2-4a06-4191-b7d0-a4fc9d584731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:38:44.864424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7dbebcf2-4a06-4191-b7d0-a4fc9d584731 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:38:44.878335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbebcf2-4a06-4191-b7d0-a4fc9d584731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:38:44.879903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbebcf2-4a06-4191-b7d0-a4fc9d584731 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:38:44.890621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1177/2329] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:38:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:38:45.078346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=63 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:54.886234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:18.096799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bfeb7-90c0-4ab8-958b-fae0b6cbbcc8 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:39:18.110041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bfeb7-90c0-4ab8-958b-fae0b6cbbcc8 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:39:18.120128 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c35ff-4a2e-4f47-a7fd-26ea4df6a390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:39:18.120744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c35ff-4a2e-4f47-a7fd-26ea4df6a390 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:18.121058 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c35ff-4a2e-4f47-a7fd-26ea4df6a390 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:18.121592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c35ff-4a2e-4f47-a7fd-26ea4df6a390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:18.123638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-407c35ff-4a2e-4f47-a7fd-26ea4df6a390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:18.137281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c35ff-4a2e-4f47-a7fd-26ea4df6a390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:39:18.139009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c35ff-4a2e-4f47-a7fd-26ea4df6a390 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:39:18.151672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1153/2330] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:39:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:39:19.365799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbebcf2-4a06-4191-b7d0-a4fc9d584731 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:39:19.378887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbebcf2-4a06-4191-b7d0-a4fc9d584731 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:39:19.385442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7bd6f-c244-4744-b530-9ad80aa43b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:39:19.386048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7bd6f-c244-4744-b530-9ad80aa43b07 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:19.386336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7bd6f-c244-4744-b530-9ad80aa43b07 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:19.386610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7bd6f-c244-4744-b530-9ad80aa43b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:19.389411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-74f7bd6f-c244-4744-b530-9ad80aa43b07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:19.450557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7bd6f-c244-4744-b530-9ad80aa43b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:39:19.452024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7bd6f-c244-4744-b530-9ad80aa43b07 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:39:19.461798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1178/2331] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:39:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:39:25.641189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d2ca6-5a1a-4b86-bcca-9eba9c41a6d1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:25.641638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d2ca6-5a1a-4b86-bcca-9eba9c41a6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:25.641734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d2ca6-5a1a-4b86-bcca-9eba9c41a6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:25.661067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6d5d2ca6-5a1a-4b86-bcca-9eba9c41a6d1 None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:39:25.662250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6d5d2ca6-5a1a-4b86-bcca-9eba9c41a6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:25.669299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1154/2332] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 10:39:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:39:25.714423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7bd6f-c244-4744-b530-9ad80aa43b07 service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:39:25.726255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7bd6f-c244-4744-b530-9ad80aa43b07 service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:39:25.731673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbffc15-c55a-4fb1-aee3-52b62cb9db90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:39:25.732256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbffc15-c55a-4fb1-aee3-52b62cb9db90 service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:25.732533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbffc15-c55a-4fb1-aee3-52b62cb9db90 service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:25.732799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbffc15-c55a-4fb1-aee3-52b62cb9db90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:25.740636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbffc15-c55a-4fb1-aee3-52b62cb9db90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:39:25.742210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbffc15-c55a-4fb1-aee3-52b62cb9db90 service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:39:25.749950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1179/2333] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:39:26.077584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d2ca6-5a1a-4b86-bcca-9eba9c41a6d1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:39:26.087117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d2ca6-5a1a-4b86-bcca-9eba9c41a6d1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:39:26.090920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf2c0f-bc0b-4ae4-8524-3da78133726b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:39:26.091526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf2c0f-bc0b-4ae4-8524-3da78133726b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:26.091803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf2c0f-bc0b-4ae4-8524-3da78133726b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:26.092072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf2c0f-bc0b-4ae4-8524-3da78133726b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:26.093819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57cf2c0f-bc0b-4ae4-8524-3da78133726b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:26.160441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf2c0f-bc0b-4ae4-8524-3da78133726b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:39:26.161962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf2c0f-bc0b-4ae4-8524-3da78133726b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:39:26.171520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1155/2334] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:39:32.354326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbffc15-c55a-4fb1-aee3-52b62cb9db90 service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:39:32.355825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1dbffc15-c55a-4fb1-aee3-52b62cb9db90 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:32.369764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbffc15-c55a-4fb1-aee3-52b62cb9db90 service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:39:32.383137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:39:32.383782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:32.384057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:32.384327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] PATH_INFO: `/v3/users/2dea780db38944c88428554903b3b1af` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:32.385456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dea780db38944c88428554903b3b1af)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:39:32.387348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:39:32.434084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dea780db38944c88428554903b3b1af'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.434729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dea780db38944c88428554903b3b1af'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.442083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dea780db38944c88428554903b3b1af'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.453842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dea780db38944c88428554903b3b1af'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.454468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dea780db38944c88428554903b3b1af'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.466795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1180/2335] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:39:32 2022] DELETE /identity/v3/users/2dea780db38944c88428554903b3b1af => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:39:32.643367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf2c0f-bc0b-4ae4-8524-3da78133726b service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:39:32.653528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf2c0f-bc0b-4ae4-8524-3da78133726b service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:39:32.710675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:39:32.711304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:32.711586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:32.711860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] PATH_INFO: `/v3/projects/2401531c25d6455dbcfc3e81713058a3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:32.712971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2401531c25d6455dbcfc3e81713058a3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:39:32.714886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:39:32.759596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2401531c25d6455dbcfc3e81713058a3', 'request_id': 'req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.765744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2401531c25d6455dbcfc3e81713058a3', 'request_id': 'req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.771831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2401531c25d6455dbcfc3e81713058a3', 'request_id': 'req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.783447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] The token cache is being invalidate because project 2401531c25d6455dbcfc3e81713058a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:39:32.784346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.784985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.786457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1156/2336] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:39:32 2022] DELETE /identity/v3/projects/2401531c25d6455dbcfc3e81713058a3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:39:32.790399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:39:32.791849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:32.804759 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288a80a-f7d0-4779-a8c1-75334b90e97e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:39:32.853280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:32.860021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:39:32.860874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:32.861358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:32.862597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] PATH_INFO: `/v3/users/4f15801b4537460cb0bcb6c4984d4bc7` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:32.864048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f15801b4537460cb0bcb6c4984d4bc7)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:39:32.866290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:39:32.912050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f15801b4537460cb0bcb6c4984d4bc7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.912728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f15801b4537460cb0bcb6c4984d4bc7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.919551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f15801b4537460cb0bcb6c4984d4bc7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.931893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f15801b4537460cb0bcb6c4984d4bc7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.932525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0334212d-cc5c-467e-8668-d46a927d39fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f15801b4537460cb0bcb6c4984d4bc7'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:32.945891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1181/2337] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:39:32 2022] DELETE /identity/v3/users/4f15801b4537460cb0bcb6c4984d4bc7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:39:33.115389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:39:33.117466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:33.129484 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:33.135669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0688c6-63b8-4aef-8ebe-7db08d64fe44 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:39:33.198656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:39:33.199317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:33.199634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:33.199908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] PATH_INFO: `/v3/projects/508a9b9b69e242289939b59e784322b3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:33.201065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=508a9b9b69e242289939b59e784322b3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:39:33.202971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:39:33.250571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508a9b9b69e242289939b59e784322b3', 'request_id': 'req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:33.257184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508a9b9b69e242289939b59e784322b3', 'request_id': 'req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:33.262795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508a9b9b69e242289939b59e784322b3', 'request_id': 'req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:33.275166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] The token cache is being invalidate because project 508a9b9b69e242289939b59e784322b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:39:33.275456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:33.276077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:39:33.277658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1157/2338] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:39:33 2022] DELETE /identity/v3/projects/508a9b9b69e242289939b59e784322b3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:39:42.942464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:43.272174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:45.430267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bc3ef-5abe-4d03-8449-d7cf6207cff8 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:45.430840 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bc3ef-5abe-4d03-8449-d7cf6207cff8 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:45.430840 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bc3ef-5abe-4d03-8449-d7cf6207cff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:45.451519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-085bc3ef-5abe-4d03-8449-d7cf6207cff8 None None] MFA Rules not processed for user `beee7ecbe9554a46a6be476aa5b2ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:39:45.452744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-085bc3ef-5abe-4d03-8449-d7cf6207cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:45.512037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1182/2339] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:39:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:39:45.835242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:39:45.836639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:45.891186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dfccc-3d4f-4f68-a019-759f14e0a4e7 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:39:45.895382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50883b2-ef8b-4a13-8200-3b004f6e1f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:39:45.895965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50883b2-ef8b-4a13-8200-3b004f6e1f9c service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:45.896239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50883b2-ef8b-4a13-8200-3b004f6e1f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:45.896507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50883b2-ef8b-4a13-8200-3b004f6e1f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:45.898178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d50883b2-ef8b-4a13-8200-3b004f6e1f9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:45.907136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50883b2-ef8b-4a13-8200-3b004f6e1f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:39:45.908527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50883b2-ef8b-4a13-8200-3b004f6e1f9c service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:39:45.916365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1158/2340] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:39:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:39:47.340192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bc3ef-5abe-4d03-8449-d7cf6207cff8 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:39:47.341679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-085bc3ef-5abe-4d03-8449-d7cf6207cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:47.427194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bc3ef-5abe-4d03-8449-d7cf6207cff8 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:39:47.432598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49c30f-c2a9-4c5c-8288-019752ada1d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:39:47.433228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c30f-c2a9-4c5c-8288-019752ada1d1 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:39:47.433506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c30f-c2a9-4c5c-8288-019752ada1d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:39:47.433774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c30f-c2a9-4c5c-8288-019752ada1d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:39:47.435446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ec49c30f-c2a9-4c5c-8288-019752ada1d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:39:47.493216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49c30f-c2a9-4c5c-8288-019752ada1d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:39:47.494766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49c30f-c2a9-4c5c-8288-019752ada1d1 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:39:47.503537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1183/2341] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:39:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:39:55.913429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=26 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:57.499477 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=81 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:09.734607 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50883b2-ef8b-4a13-8200-3b004f6e1f9c service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:09.744195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50883b2-ef8b-4a13-8200-3b004f6e1f9c service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:09.747910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bfdeb-ddd2-47b8-8a34-c58729110494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:09.748765 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bfdeb-ddd2-47b8-8a34-c58729110494 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:09.749230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bfdeb-ddd2-47b8-8a34-c58729110494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:09.749658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bfdeb-ddd2-47b8-8a34-c58729110494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:09.752080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5e5bfdeb-ddd2-47b8-8a34-c58729110494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:09.825045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bfdeb-ddd2-47b8-8a34-c58729110494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:09.826495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bfdeb-ddd2-47b8-8a34-c58729110494 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:09.840000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1159/2342] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:11.109848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c0606-ebd9-4365-8140-af33a63f648b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:11.110316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c0606-ebd9-4365-8140-af33a63f648b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:11.110594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c0606-ebd9-4365-8140-af33a63f648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:11.133635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ab4c0606-ebd9-4365-8140-af33a63f648b None None] MFA Rules not processed for user `79deff91d5c046c4bbe7b2e47b21ba66`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:11.134919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ab4c0606-ebd9-4365-8140-af33a63f648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:11.142604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1184/2343] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:13.731077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bfdeb-ddd2-47b8-8a34-c58729110494 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:13.732586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5e5bfdeb-ddd2-47b8-8a34-c58729110494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:13.745564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bfdeb-ddd2-47b8-8a34-c58729110494 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:13.750168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:13.750813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:13.751092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:13.751365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] PATH_INFO: `/v3/users/85869eddd2924f85a318e77184c5607b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:13.752585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] RBAC: Authorizing `identity:delete_user(user_id=85869eddd2924f85a318e77184c5607b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:13.754621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:13.805796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85869eddd2924f85a318e77184c5607b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:13.813365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85869eddd2924f85a318e77184c5607b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:13.813987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85869eddd2924f85a318e77184c5607b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:13.821044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85869eddd2924f85a318e77184c5607b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:13.833568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0e6856f7-3e66-4a82-8620-577f00bd10df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85869eddd2924f85a318e77184c5607b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:13.839537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1160/2344] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:40:13 2022] DELETE /identity/v3/users/85869eddd2924f85a318e77184c5607b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:14.056121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c0606-ebd9-4365-8140-af33a63f648b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:14.067342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c0606-ebd9-4365-8140-af33a63f648b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:14.132116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:14.132869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.133055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.133351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] PATH_INFO: `/v3/projects/68d0920612044dcf9d23e21f9b2561d2` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.134482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d0920612044dcf9d23e21f9b2561d2)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:14.136374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:14.185712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d0920612044dcf9d23e21f9b2561d2', 'request_id': 'req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:14.192607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d0920612044dcf9d23e21f9b2561d2', 'request_id': 'req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:14.199027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d0920612044dcf9d23e21f9b2561d2', 'request_id': 'req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:14.212815 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] The token cache is being invalidate because project 68d0920612044dcf9d23e21f9b2561d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:40:14.213148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:14.213796 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-750fe741-b1d3-41f3-ba4f-e1eb0ab73331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:14.215487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1185/2345] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:40:14 2022] DELETE /identity/v3/projects/68d0920612044dcf9d23e21f9b2561d2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:14.220738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f624-eb91-4c7c-a85a-c28803a627ed None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.221708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f624-eb91-4c7c-a85a-c28803a627ed None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.221708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f624-eb91-4c7c-a85a-c28803a627ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.246244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-51a8f624-eb91-4c7c-a85a-c28803a627ed None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:14.247441 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-51a8f624-eb91-4c7c-a85a-c28803a627ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:14.311274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1161/2346] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:40:14.319544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dccdea-bc34-47d9-8371-dd6e0c95d55b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.319925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dccdea-bc34-47d9-8371-dd6e0c95d55b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.320253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dccdea-bc34-47d9-8371-dd6e0c95d55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.343954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c6dccdea-bc34-47d9-8371-dd6e0c95d55b None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:14.345214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c6dccdea-bc34-47d9-8371-dd6e0c95d55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:14.353309 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1186/2347] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:14.357657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8f624-eb91-4c7c-a85a-c28803a627ed None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:14.370767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8f624-eb91-4c7c-a85a-c28803a627ed None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:14.375511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26c1d-6e48-4773-b4e1-ecc2b826bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:14.376116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26c1d-6e48-4773-b4e1-ecc2b826bd2c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.376395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26c1d-6e48-4773-b4e1-ecc2b826bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.376664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e26c1d-6e48-4773-b4e1-ecc2b826bd2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.377346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e26c1d-6e48-4773-b4e1-ecc2b826bd2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:40:14.377646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e26c1d-6e48-4773-b4e1-ecc2b826bd2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:14.379753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e26c1d-6e48-4773-b4e1-ecc2b826bd2c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:14.381419 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:14.391825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1162/2348] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:40:14.397012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dccdea-bc34-47d9-8371-dd6e0c95d55b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:14.407001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dccdea-bc34-47d9-8371-dd6e0c95d55b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:14.412012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e2d8e-b8f4-4c6d-a18f-dcd39626ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:14.412516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e2d8e-b8f4-4c6d-a18f-dcd39626ee66 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.412828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e2d8e-b8f4-4c6d-a18f-dcd39626ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.413166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e2d8e-b8f4-4c6d-a18f-dcd39626ee66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.413800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e2d8e-b8f4-4c6d-a18f-dcd39626ee66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:14.415691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e2d8e-b8f4-4c6d-a18f-dcd39626ee66 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:14.448316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1187/2349] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:40:14 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:14.452568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26c1d-6e48-4773-b4e1-ecc2b826bd2c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:14.464519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e26c1d-6e48-4773-b4e1-ecc2b826bd2c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:14.533207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a1c06-b58a-4d88-87b2-11feca793e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:14.533923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a1c06-b58a-4d88-87b2-11feca793e23 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.534275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a1c06-b58a-4d88-87b2-11feca793e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.535885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a1c06-b58a-4d88-87b2-11feca793e23 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.535885 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a1c06-b58a-4d88-87b2-11feca793e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:14.537139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a1c06-b58a-4d88-87b2-11feca793e23 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:14.564917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1163/2350] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:40:14 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:40:14.569296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e2d8e-b8f4-4c6d-a18f-dcd39626ee66 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:14.583359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e2d8e-b8f4-4c6d-a18f-dcd39626ee66 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:14.590665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439563e-07b0-4f31-bdd2-c72163f88252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:14.591547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439563e-07b0-4f31-bdd2-c72163f88252 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.591987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439563e-07b0-4f31-bdd2-c72163f88252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.592433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439563e-07b0-4f31-bdd2-c72163f88252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.593265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439563e-07b0-4f31-bdd2-c72163f88252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:14.596600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439563e-07b0-4f31-bdd2-c72163f88252 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:14.608523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1188/2351] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:14.615308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a1c06-b58a-4d88-87b2-11feca793e23 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:14.627457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a1c06-b58a-4d88-87b2-11feca793e23 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:14.633209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac677c-697a-4bec-8803-4918c7553055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:14.633811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac677c-697a-4bec-8803-4918c7553055 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.634092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac677c-697a-4bec-8803-4918c7553055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.634363 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac677c-697a-4bec-8803-4918c7553055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.635004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac677c-697a-4bec-8803-4918c7553055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:14.636617 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac677c-697a-4bec-8803-4918c7553055 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:14.648378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1164/2352] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:14.652517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439563e-07b0-4f31-bdd2-c72163f88252 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:14.663215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439563e-07b0-4f31-bdd2-c72163f88252 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:14.667875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4b236-7359-463c-ad66-821d759c98ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:14.668523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4b236-7359-463c-ad66-821d759c98ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.668803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4b236-7359-463c-ad66-821d759c98ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.669221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4b236-7359-463c-ad66-821d759c98ee admin admin] PATH_INFO: `/v3/projects/e75f1998d32e4e29b4feccf97f79ec49/users/b6b2282279a3489889e4c1d37f26ea44/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.685070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4b236-7359-463c-ad66-821d759c98ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75f1998d32e4e29b4feccf97f79ec49, user_id=b6b2282279a3489889e4c1d37f26ea44, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:14.687690 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4b236-7359-463c-ad66-821d759c98ee admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:14.702460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1189/2353] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:14 2022] PUT /identity/v3/projects/e75f1998d32e4e29b4feccf97f79ec49/users/b6b2282279a3489889e4c1d37f26ea44/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:14.714814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2aa9a-fe7e-4e56-8134-c6448a8b26bf None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.715111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2aa9a-fe7e-4e56-8134-c6448a8b26bf None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.715385 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2aa9a-fe7e-4e56-8134-c6448a8b26bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.745998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-32d2aa9a-fe7e-4e56-8134-c6448a8b26bf None None] MFA Rules not processed for user `b6b2282279a3489889e4c1d37f26ea44`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:14.748167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-32d2aa9a-fe7e-4e56-8134-c6448a8b26bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:14.817485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1165/2354] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:14.828082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4b236-7359-463c-ad66-821d759c98ee admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:14.829790 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-61c4b236-7359-463c-ad66-821d759c98ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:14.852710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:14.889907 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4b236-7359-463c-ad66-821d759c98ee admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:14.893472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b31eca-a310-4c4a-8fe6-f70364c38af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:14.894518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b31eca-a310-4c4a-8fe6-f70364c38af3 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:14.894518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b31eca-a310-4c4a-8fe6-f70364c38af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:14.894756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b31eca-a310-4c4a-8fe6-f70364c38af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:14.903296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b31eca-a310-4c4a-8fe6-f70364c38af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:14.904710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b31eca-a310-4c4a-8fe6-f70364c38af3 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:14.914214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1190/2355] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:23.353256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2aa9a-fe7e-4e56-8134-c6448a8b26bf None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:23.413859 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2aa9a-fe7e-4e56-8134-c6448a8b26bf None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:23.418341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:23.418956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:23.419232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:23.419498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] PATH_INFO: `/v3/users/b6b2282279a3489889e4c1d37f26ea44` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:23.420588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b2282279a3489889e4c1d37f26ea44)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:23.422512 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:23.424753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:23.467778 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b2282279a3489889e4c1d37f26ea44'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:23.474830 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b2282279a3489889e4c1d37f26ea44'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:23.475438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b2282279a3489889e4c1d37f26ea44'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:23.482225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b2282279a3489889e4c1d37f26ea44'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:23.494511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b2282279a3489889e4c1d37f26ea44'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:23.500661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1166/2356] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:40:23 2022] DELETE /identity/v3/users/b6b2282279a3489889e4c1d37f26ea44 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:23.505524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245b96-efb4-4b12-a6c9-ab32c44c7b40 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:23.506020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245b96-efb4-4b12-a6c9-ab32c44c7b40 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:23.506135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245b96-efb4-4b12-a6c9-ab32c44c7b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:23.525975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0e245b96-efb4-4b12-a6c9-ab32c44c7b40 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:23.527282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0e245b96-efb4-4b12-a6c9-ab32c44c7b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:23.590100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1191/2357] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:23.601222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:23.602629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:23.663963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ad59f-0317-4964-8c7d-f20bd4355255 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:23.667792 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e501c45-3447-4adf-8dc2-789f22be8b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:23.668396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501c45-3447-4adf-8dc2-789f22be8b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:23.668680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501c45-3447-4adf-8dc2-789f22be8b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:23.668971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501c45-3447-4adf-8dc2-789f22be8b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:23.679168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e501c45-3447-4adf-8dc2-789f22be8b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:23.680591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e501c45-3447-4adf-8dc2-789f22be8b10 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:23.690157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1167/2358] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:24.088435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e245b96-efb4-4b12-a6c9-ab32c44c7b40 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:24.089921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0e245b96-efb4-4b12-a6c9-ab32c44c7b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:24.102837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e245b96-efb4-4b12-a6c9-ab32c44c7b40 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:24.108067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:24.108816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.109144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.109420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] PATH_INFO: `/v3/projects/e75f1998d32e4e29b4feccf97f79ec49` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.110553 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75f1998d32e4e29b4feccf97f79ec49)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:24.112445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:24.158022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75f1998d32e4e29b4feccf97f79ec49', 'request_id': 'req-db73c898-6b96-4b3d-a1ac-c03b94fff071'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:24.164605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75f1998d32e4e29b4feccf97f79ec49', 'request_id': 'req-db73c898-6b96-4b3d-a1ac-c03b94fff071'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:24.170721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75f1998d32e4e29b4feccf97f79ec49', 'request_id': 'req-db73c898-6b96-4b3d-a1ac-c03b94fff071'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:24.184339 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] The token cache is being invalidate because project e75f1998d32e4e29b4feccf97f79ec49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:40:24.184638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:24.185266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-db73c898-6b96-4b3d-a1ac-c03b94fff071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:24.186961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1192/2359] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:40:24 2022] DELETE /identity/v3/projects/e75f1998d32e4e29b4feccf97f79ec49 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:24.192803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c5f3-2c67-40f9-b907-bb1bd7c8fabb None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.193125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c5f3-2c67-40f9-b907-bb1bd7c8fabb None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.193400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640c5f3-2c67-40f9-b907-bb1bd7c8fabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.212646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d640c5f3-2c67-40f9-b907-bb1bd7c8fabb None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:24.213877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d640c5f3-2c67-40f9-b907-bb1bd7c8fabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:24.273809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1168/2360] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:24.281636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee84c2-37cd-4df3-9d88-46f1d45cdc8d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.282010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee84c2-37cd-4df3-9d88-46f1d45cdc8d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.282295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee84c2-37cd-4df3-9d88-46f1d45cdc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.302270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c3ee84c2-37cd-4df3-9d88-46f1d45cdc8d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:24.303485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c3ee84c2-37cd-4df3-9d88-46f1d45cdc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:24.311736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1193/2361] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:24.316372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640c5f3-2c67-40f9-b907-bb1bd7c8fabb None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:24.326363 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640c5f3-2c67-40f9-b907-bb1bd7c8fabb None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:24.331010 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68650-a1c7-404f-a0f5-ca65ae0f54fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:24.332158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68650-a1c7-404f-a0f5-ca65ae0f54fe admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.332437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68650-a1c7-404f-a0f5-ca65ae0f54fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.332705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68650-a1c7-404f-a0f5-ca65ae0f54fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.333380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68650-a1c7-404f-a0f5-ca65ae0f54fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:40:24.333680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68650-a1c7-404f-a0f5-ca65ae0f54fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:24.335310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68650-a1c7-404f-a0f5-ca65ae0f54fe admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:24.347726 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1169/2362] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:40:24.351734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee84c2-37cd-4df3-9d88-46f1d45cdc8d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:24.361395 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee84c2-37cd-4df3-9d88-46f1d45cdc8d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:24.366997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1b868-26c5-4c03-9c3f-cc4efd5a4a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:24.367826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1b868-26c5-4c03-9c3f-cc4efd5a4a04 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.368351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1b868-26c5-4c03-9c3f-cc4efd5a4a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.368824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1b868-26c5-4c03-9c3f-cc4efd5a4a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.369723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1b868-26c5-4c03-9c3f-cc4efd5a4a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:24.371965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1b868-26c5-4c03-9c3f-cc4efd5a4a04 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:24.402318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1194/2363] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:40:24 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:40:24.403720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68650-a1c7-404f-a0f5-ca65ae0f54fe admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:24.414014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68650-a1c7-404f-a0f5-ca65ae0f54fe admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:24.422036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:24.474495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e792d-a672-4535-90a0-91a4f937c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:24.475096 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e792d-a672-4535-90a0-91a4f937c913 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.475374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e792d-a672-4535-90a0-91a4f937c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.475645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e792d-a672-4535-90a0-91a4f937c913 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.476268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e792d-a672-4535-90a0-91a4f937c913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:24.478198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e792d-a672-4535-90a0-91a4f937c913 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:24.499411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1170/2364] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:40:24 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:24.503587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1b868-26c5-4c03-9c3f-cc4efd5a4a04 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:24.513828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1b868-26c5-4c03-9c3f-cc4efd5a4a04 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:24.518409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880af07-4a5d-4f46-b2b6-b84f86b8d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:24.519529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880af07-4a5d-4f46-b2b6-b84f86b8d456 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.519807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880af07-4a5d-4f46-b2b6-b84f86b8d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.520078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880af07-4a5d-4f46-b2b6-b84f86b8d456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.520716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880af07-4a5d-4f46-b2b6-b84f86b8d456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:24.522331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880af07-4a5d-4f46-b2b6-b84f86b8d456 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:24.532279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1195/2365] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:24.537064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e792d-a672-4535-90a0-91a4f937c913 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:24.547252 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e792d-a672-4535-90a0-91a4f937c913 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:24.551905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325ee11-1629-4c36-bb0f-0bbe7977f691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:24.552499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325ee11-1629-4c36-bb0f-0bbe7977f691 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.552779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325ee11-1629-4c36-bb0f-0bbe7977f691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.553081 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325ee11-1629-4c36-bb0f-0bbe7977f691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.553725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325ee11-1629-4c36-bb0f-0bbe7977f691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:24.555310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325ee11-1629-4c36-bb0f-0bbe7977f691 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:24.566247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1171/2366] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:24.570551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880af07-4a5d-4f46-b2b6-b84f86b8d456 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:24.580266 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880af07-4a5d-4f46-b2b6-b84f86b8d456 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:24.585891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d3cd4-152e-438a-8e9b-c70c22f0098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:24.586052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d3cd4-152e-438a-8e9b-c70c22f0098a admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.586318 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d3cd4-152e-438a-8e9b-c70c22f0098a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.586591 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d3cd4-152e-438a-8e9b-c70c22f0098a admin admin] PATH_INFO: `/v3/projects/950298aa912d47b7b747aa3573826b3f/users/8bfae197ca434211ad2231aff0a3a42b/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.588774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:24.604420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d3cd4-152e-438a-8e9b-c70c22f0098a admin admin] RBAC: Authorizing `identity:create_grant(project_id=950298aa912d47b7b747aa3573826b3f, user_id=8bfae197ca434211ad2231aff0a3a42b, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:24.607056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d3cd4-152e-438a-8e9b-c70c22f0098a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:24.620238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1196/2367] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:24 2022] PUT /identity/v3/projects/950298aa912d47b7b747aa3573826b3f/users/8bfae197ca434211ad2231aff0a3a42b/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:24.630616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8986-009d-41a3-b3c7-5cb84c870c9f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.630927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8986-009d-41a3-b3c7-5cb84c870c9f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.631205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8986-009d-41a3-b3c7-5cb84c870c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.658841 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9b8d8986-009d-41a3-b3c7-5cb84c870c9f None None] MFA Rules not processed for user `8bfae197ca434211ad2231aff0a3a42b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:24.660576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9b8d8986-009d-41a3-b3c7-5cb84c870c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:24.725443 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1172/2368] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:24.729924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d3cd4-152e-438a-8e9b-c70c22f0098a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:24.793006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d3cd4-152e-438a-8e9b-c70c22f0098a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:24.797615 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad53ea7-024d-4b7a-9313-840ea3f8b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:24.798212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad53ea7-024d-4b7a-9313-840ea3f8b143 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.798491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad53ea7-024d-4b7a-9313-840ea3f8b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.798762 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad53ea7-024d-4b7a-9313-840ea3f8b143 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.799388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad53ea7-024d-4b7a-9313-840ea3f8b143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:24.801866 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad53ea7-024d-4b7a-9313-840ea3f8b143 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:24.829407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1197/2369] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:40:24 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:24.833972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8986-009d-41a3-b3c7-5cb84c870c9f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:24.845616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8986-009d-41a3-b3c7-5cb84c870c9f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:24.906835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9705a-5422-4a37-a77b-f2e7b8ebc6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:24.907468 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9705a-5422-4a37-a77b-f2e7b8ebc6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.907746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9705a-5422-4a37-a77b-f2e7b8ebc6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.908013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9705a-5422-4a37-a77b-f2e7b8ebc6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.908649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9705a-5422-4a37-a77b-f2e7b8ebc6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:24.910781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9705a-5422-4a37-a77b-f2e7b8ebc6b6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:24.932632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1173/2370] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:40:24 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:24.936593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad53ea7-024d-4b7a-9313-840ea3f8b143 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:24.950423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad53ea7-024d-4b7a-9313-840ea3f8b143 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:24.956630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48771b6e-451f-4299-b18e-3d1e1f6438e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:24.957803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48771b6e-451f-4299-b18e-3d1e1f6438e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:24.958083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48771b6e-451f-4299-b18e-3d1e1f6438e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:24.958342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48771b6e-451f-4299-b18e-3d1e1f6438e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:24.958992 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48771b6e-451f-4299-b18e-3d1e1f6438e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:24.960627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48771b6e-451f-4299-b18e-3d1e1f6438e3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:24.992636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1198/2371] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:24.998122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9705a-5422-4a37-a77b-f2e7b8ebc6b6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:25.021950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9705a-5422-4a37-a77b-f2e7b8ebc6b6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:25.036780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d1fd6-90a5-415b-b1dc-17083184c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:25.038006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d1fd6-90a5-415b-b1dc-17083184c4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:25.038632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d1fd6-90a5-415b-b1dc-17083184c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:25.039049 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d1fd6-90a5-415b-b1dc-17083184c4a6 admin admin] PATH_INFO: `/v3/projects/2461f4e733a94c51ad898b3c1ddc75b9/users/46b78641688946598cd68f89281003ea/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:25.043839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:25.060038 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d1fd6-90a5-415b-b1dc-17083184c4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2461f4e733a94c51ad898b3c1ddc75b9, user_id=46b78641688946598cd68f89281003ea, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:25.063563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d1fd6-90a5-415b-b1dc-17083184c4a6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:25.082195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1174/2372] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:24 2022] PUT /identity/v3/projects/2461f4e733a94c51ad898b3c1ddc75b9/users/46b78641688946598cd68f89281003ea/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:40:25.086221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48771b6e-451f-4299-b18e-3d1e1f6438e3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:25.097453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48771b6e-451f-4299-b18e-3d1e1f6438e3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:25.172653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5867a-f7bb-40f5-989f-d1e366a1fbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:25.174119 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5867a-f7bb-40f5-989f-d1e366a1fbfe admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:25.174400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5867a-f7bb-40f5-989f-d1e366a1fbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:25.174727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5867a-f7bb-40f5-989f-d1e366a1fbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:25.175460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5867a-f7bb-40f5-989f-d1e366a1fbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:25.177317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5867a-f7bb-40f5-989f-d1e366a1fbfe admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:25.188354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1199/2373] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:40:25.192750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d1fd6-90a5-415b-b1dc-17083184c4a6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:25.203469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d1fd6-90a5-415b-b1dc-17083184c4a6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:25.208712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05719d-b6bf-44f7-b545-f6c3a324cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:25.209415 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05719d-b6bf-44f7-b545-f6c3a324cb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:25.209694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05719d-b6bf-44f7-b545-f6c3a324cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:25.209976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05719d-b6bf-44f7-b545-f6c3a324cb23 admin admin] PATH_INFO: `/v3/projects/2461f4e733a94c51ad898b3c1ddc75b9/users/46b78641688946598cd68f89281003ea/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:25.211879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05719d-b6bf-44f7-b545-f6c3a324cb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2461f4e733a94c51ad898b3c1ddc75b9, user_id=46b78641688946598cd68f89281003ea, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:25.214553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05719d-b6bf-44f7-b545-f6c3a324cb23 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:25.226846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1175/2374] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:25 2022] PUT /identity/v3/projects/2461f4e733a94c51ad898b3c1ddc75b9/users/46b78641688946598cd68f89281003ea/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:25.238607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce76b3e-5c56-4793-911e-e845c2ae3e51 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:25.238877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce76b3e-5c56-4793-911e-e845c2ae3e51 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:25.239151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce76b3e-5c56-4793-911e-e845c2ae3e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:25.268766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1ce76b3e-5c56-4793-911e-e845c2ae3e51 None None] MFA Rules not processed for user `46b78641688946598cd68f89281003ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:25.270543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1ce76b3e-5c56-4793-911e-e845c2ae3e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:25.316249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:25.346105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1200/2375] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:25.359476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05719d-b6bf-44f7-b545-f6c3a324cb23 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:25.361447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5b05719d-b6bf-44f7-b545-f6c3a324cb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:25.424528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05719d-b6bf-44f7-b545-f6c3a324cb23 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:25.428256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adecdd-1dc7-4c83-a896-2037033ad079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:25.428863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adecdd-1dc7-4c83-a896-2037033ad079 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:25.429174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adecdd-1dc7-4c83-a896-2037033ad079 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:25.429451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adecdd-1dc7-4c83-a896-2037033ad079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:25.438657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adecdd-1dc7-4c83-a896-2037033ad079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:25.440084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adecdd-1dc7-4c83-a896-2037033ad079 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:25.450217 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1176/2376] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:27.021394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce76b3e-5c56-4793-911e-e845c2ae3e51 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:27.082091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce76b3e-5c56-4793-911e-e845c2ae3e51 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:27.086538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:27.087155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:27.087436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:27.087709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] PATH_INFO: `/v3/users/8bfae197ca434211ad2231aff0a3a42b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:27.088837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfae197ca434211ad2231aff0a3a42b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:27.090773 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:27.136734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfae197ca434211ad2231aff0a3a42b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.137406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfae197ca434211ad2231aff0a3a42b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.145017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfae197ca434211ad2231aff0a3a42b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.156847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfae197ca434211ad2231aff0a3a42b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.157519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfae197ca434211ad2231aff0a3a42b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.170157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1201/2377] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:40:27 2022] DELETE /identity/v3/users/8bfae197ca434211ad2231aff0a3a42b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:27.174577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0f134-ff91-4db0-8ac1-669c5faa8943 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:27.175034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0f134-ff91-4db0-8ac1-669c5faa8943 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:27.175127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0f134-ff91-4db0-8ac1-669c5faa8943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:27.193940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-57f0f134-ff91-4db0-8ac1-669c5faa8943 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:27.195131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57f0f134-ff91-4db0-8ac1-669c5faa8943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:27.254983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1177/2378] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:27.264564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:27.265967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:27.321629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ed980-e4b4-4d19-8dd8-2d872464157a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:27.325238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834bea0-3637-4402-95b2-1120e90e368e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:27.325833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834bea0-3637-4402-95b2-1120e90e368e service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:27.326110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834bea0-3637-4402-95b2-1120e90e368e service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:27.326377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834bea0-3637-4402-95b2-1120e90e368e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:27.335728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834bea0-3637-4402-95b2-1120e90e368e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:27.337329 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834bea0-3637-4402-95b2-1120e90e368e service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:27.342379 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:27.347896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1202/2379] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:27.614575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0f134-ff91-4db0-8ac1-669c5faa8943 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:27.616255 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-57f0f134-ff91-4db0-8ac1-669c5faa8943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:27.632472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0f134-ff91-4db0-8ac1-669c5faa8943 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:27.637431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:27.638069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:27.638382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:27.638660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] PATH_INFO: `/v3/projects/950298aa912d47b7b747aa3573826b3f` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:27.639793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950298aa912d47b7b747aa3573826b3f)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:27.641785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:27.689540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950298aa912d47b7b747aa3573826b3f', 'request_id': 'req-60c501f5-f8c5-4c52-8195-ae4925c83585'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.695497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950298aa912d47b7b747aa3573826b3f', 'request_id': 'req-60c501f5-f8c5-4c52-8195-ae4925c83585'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.700850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950298aa912d47b7b747aa3573826b3f', 'request_id': 'req-60c501f5-f8c5-4c52-8195-ae4925c83585'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.709037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:27.714269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] The token cache is being invalidate because project 950298aa912d47b7b747aa3573826b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:40:27.714616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.715558 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.717436 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1178/2380] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:40:27 2022] DELETE /identity/v3/projects/950298aa912d47b7b747aa3573826b3f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:27.721707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834bea0-3637-4402-95b2-1120e90e368e service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:27.733137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834bea0-3637-4402-95b2-1120e90e368e service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:27.803216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:27.803757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:27.804043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:27.804450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] PATH_INFO: `/v3/users/46b78641688946598cd68f89281003ea` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:27.806156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b78641688946598cd68f89281003ea)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:27.808062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:27.857205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b78641688946598cd68f89281003ea'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.858005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b78641688946598cd68f89281003ea'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.866280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b78641688946598cd68f89281003ea'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.878507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b78641688946598cd68f89281003ea'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.879455 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-efbf1829-7fde-4dfb-b452-6e717a9742f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b78641688946598cd68f89281003ea'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:27.901435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1203/2381] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:40:27 2022] DELETE /identity/v3/users/46b78641688946598cd68f89281003ea => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:28.188316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:28.189822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:28.205658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c501f5-f8c5-4c52-8195-ae4925c83585 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:28.262544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:28.263174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.263454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.263729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] PATH_INFO: `/v3/projects/2461f4e733a94c51ad898b3c1ddc75b9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.264990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2461f4e733a94c51ad898b3c1ddc75b9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:28.266902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:28.312203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2461f4e733a94c51ad898b3c1ddc75b9', 'request_id': 'req-cd304a01-09c7-42a5-b9d5-44e8bb352618'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:28.318934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2461f4e733a94c51ad898b3c1ddc75b9', 'request_id': 'req-cd304a01-09c7-42a5-b9d5-44e8bb352618'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:28.324478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2461f4e733a94c51ad898b3c1ddc75b9', 'request_id': 'req-cd304a01-09c7-42a5-b9d5-44e8bb352618'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:28.336343 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] The token cache is being invalidate because project 2461f4e733a94c51ad898b3c1ddc75b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:40:28.336636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:28.337280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cd304a01-09c7-42a5-b9d5-44e8bb352618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:28.338759 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1179/2382] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:40:28 2022] DELETE /identity/v3/projects/2461f4e733a94c51ad898b3c1ddc75b9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:28.343558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da50eef-d77f-4796-9f53-c865bae6ef39 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.344016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da50eef-d77f-4796-9f53-c865bae6ef39 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.344148 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da50eef-d77f-4796-9f53-c865bae6ef39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.364557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7da50eef-d77f-4796-9f53-c865bae6ef39 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:28.365789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7da50eef-d77f-4796-9f53-c865bae6ef39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:28.423606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1204/2383] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:28.432422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90335939-d37d-403e-8bfb-ff5c39846ad9 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.432703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90335939-d37d-403e-8bfb-ff5c39846ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.432995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90335939-d37d-403e-8bfb-ff5c39846ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.452496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-90335939-d37d-403e-8bfb-ff5c39846ad9 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:28.453727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-90335939-d37d-403e-8bfb-ff5c39846ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:28.461555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1180/2384] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:28.465813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da50eef-d77f-4796-9f53-c865bae6ef39 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:28.476472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da50eef-d77f-4796-9f53-c865bae6ef39 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:28.481273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176157f8-f293-4154-a457-a14cf52148cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:28.481862 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176157f8-f293-4154-a457-a14cf52148cf admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.482138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176157f8-f293-4154-a457-a14cf52148cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.482407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176157f8-f293-4154-a457-a14cf52148cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.483038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176157f8-f293-4154-a457-a14cf52148cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:40:28.483338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176157f8-f293-4154-a457-a14cf52148cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:28.484941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176157f8-f293-4154-a457-a14cf52148cf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:28.497123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1205/2385] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:40:28.501508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90335939-d37d-403e-8bfb-ff5c39846ad9 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:28.511330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90335939-d37d-403e-8bfb-ff5c39846ad9 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:28.516151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa37c6b-8040-48f7-b9c6-781ff9a0dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:28.516740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa37c6b-8040-48f7-b9c6-781ff9a0dc8c admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.517056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa37c6b-8040-48f7-b9c6-781ff9a0dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.517354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa37c6b-8040-48f7-b9c6-781ff9a0dc8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.518024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa37c6b-8040-48f7-b9c6-781ff9a0dc8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:28.520541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa37c6b-8040-48f7-b9c6-781ff9a0dc8c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:28.548170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1181/2386] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:40:28 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:28.553321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176157f8-f293-4154-a457-a14cf52148cf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:28.564448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176157f8-f293-4154-a457-a14cf52148cf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:28.567987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:28.626522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9832c2-a0ff-43ec-a401-562d8ad5a685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:28.627624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9832c2-a0ff-43ec-a401-562d8ad5a685 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.627624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9832c2-a0ff-43ec-a401-562d8ad5a685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.629027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9832c2-a0ff-43ec-a401-562d8ad5a685 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.629878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9832c2-a0ff-43ec-a401-562d8ad5a685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:28.631819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9832c2-a0ff-43ec-a401-562d8ad5a685 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:28.652855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1206/2387] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:40:28 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:40:28.657256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa37c6b-8040-48f7-b9c6-781ff9a0dc8c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:28.667640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa37c6b-8040-48f7-b9c6-781ff9a0dc8c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:28.672196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42209e2e-fa4f-4846-a7fa-d589b6f7f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:28.672789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42209e2e-fa4f-4846-a7fa-d589b6f7f1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.673103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42209e2e-fa4f-4846-a7fa-d589b6f7f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.673377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42209e2e-fa4f-4846-a7fa-d589b6f7f1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.674015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42209e2e-fa4f-4846-a7fa-d589b6f7f1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:28.675596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42209e2e-fa4f-4846-a7fa-d589b6f7f1d0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:28.685647 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1182/2388] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:28.689479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9832c2-a0ff-43ec-a401-562d8ad5a685 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:28.699899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9832c2-a0ff-43ec-a401-562d8ad5a685 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:28.704502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b4c89-ede4-4309-a27b-b63edc70d029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:28.705186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4c89-ede4-4309-a27b-b63edc70d029 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.705472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4c89-ede4-4309-a27b-b63edc70d029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.705755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4c89-ede4-4309-a27b-b63edc70d029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.706393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b4c89-ede4-4309-a27b-b63edc70d029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:28.708584 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b4c89-ede4-4309-a27b-b63edc70d029 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:28.718580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1207/2389] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:28.723404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42209e2e-fa4f-4846-a7fa-d589b6f7f1d0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:28.736524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42209e2e-fa4f-4846-a7fa-d589b6f7f1d0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:28.743408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb59d1a-146b-4802-8e14-f5724338ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:28.744286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59d1a-146b-4802-8e14-f5724338ac4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.744670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59d1a-146b-4802-8e14-f5724338ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.745082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59d1a-146b-4802-8e14-f5724338ac4e admin admin] PATH_INFO: `/v3/projects/6a2e36a9bb714b2a965ea7911f97291e/users/148d4cec9d624b5dbea57313ef06d232/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.759936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb59d1a-146b-4802-8e14-f5724338ac4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2e36a9bb714b2a965ea7911f97291e, user_id=148d4cec9d624b5dbea57313ef06d232, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:28.762586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb59d1a-146b-4802-8e14-f5724338ac4e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:28.775366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1183/2390] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:28 2022] PUT /identity/v3/projects/6a2e36a9bb714b2a965ea7911f97291e/users/148d4cec9d624b5dbea57313ef06d232/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:28.787173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71d64-750c-4b55-826e-1bab827d4f96 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.787465 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71d64-750c-4b55-826e-1bab827d4f96 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.787768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71d64-750c-4b55-826e-1bab827d4f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.815565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9ff71d64-750c-4b55-826e-1bab827d4f96 None None] MFA Rules not processed for user `148d4cec9d624b5dbea57313ef06d232`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:28.816852 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9ff71d64-750c-4b55-826e-1bab827d4f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:28.880923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1208/2391] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:28.885394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb59d1a-146b-4802-8e14-f5724338ac4e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:28.914872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:28.953941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb59d1a-146b-4802-8e14-f5724338ac4e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:28.959090 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a15c5-9e1c-46c7-9cc0-716f125c6e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:28.959793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a15c5-9e1c-46c7-9cc0-716f125c6e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:28.960094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a15c5-9e1c-46c7-9cc0-716f125c6e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:28.960365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a15c5-9e1c-46c7-9cc0-716f125c6e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:28.961016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a15c5-9e1c-46c7-9cc0-716f125c6e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:28.962917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a15c5-9e1c-46c7-9cc0-716f125c6e66 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:28.992807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1184/2392] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:40:28 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:28.993948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff71d64-750c-4b55-826e-1bab827d4f96 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:29.004671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff71d64-750c-4b55-826e-1bab827d4f96 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:29.068941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d6c33-8660-4552-8bca-c3c4b9afb4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:29.069605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d6c33-8660-4552-8bca-c3c4b9afb4ef admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:29.069887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d6c33-8660-4552-8bca-c3c4b9afb4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:29.070159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d6c33-8660-4552-8bca-c3c4b9afb4ef admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:29.070839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d6c33-8660-4552-8bca-c3c4b9afb4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:29.072877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d6c33-8660-4552-8bca-c3c4b9afb4ef admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:29.095319 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1209/2393] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:40:28 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:40:29.099409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a15c5-9e1c-46c7-9cc0-716f125c6e66 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:29.110222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a15c5-9e1c-46c7-9cc0-716f125c6e66 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:29.115997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5091dc-4ef4-4abc-b26d-34e458f8c3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:29.116634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5091dc-4ef4-4abc-b26d-34e458f8c3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:29.116913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5091dc-4ef4-4abc-b26d-34e458f8c3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:29.117227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5091dc-4ef4-4abc-b26d-34e458f8c3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:29.117871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5091dc-4ef4-4abc-b26d-34e458f8c3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:29.119584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5091dc-4ef4-4abc-b26d-34e458f8c3ed admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:29.131088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1185/2394] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:29.135467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d6c33-8660-4552-8bca-c3c4b9afb4ef admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:29.141744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:29.145789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d6c33-8660-4552-8bca-c3c4b9afb4ef admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:29.150753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d12c48-8a25-44b4-9630-36ec95510ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:29.151406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d12c48-8a25-44b4-9630-36ec95510ade admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:29.151689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d12c48-8a25-44b4-9630-36ec95510ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:29.151975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d12c48-8a25-44b4-9630-36ec95510ade admin admin] PATH_INFO: `/v3/projects/53eca91b135b4b129b4f9fcfc476128e/users/8b4377291c214df4b00fe483b293efad/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:29.168611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d12c48-8a25-44b4-9630-36ec95510ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=53eca91b135b4b129b4f9fcfc476128e, user_id=8b4377291c214df4b00fe483b293efad, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:29.171310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d12c48-8a25-44b4-9630-36ec95510ade admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:29.185438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1210/2395] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:29 2022] PUT /identity/v3/projects/53eca91b135b4b129b4f9fcfc476128e/users/8b4377291c214df4b00fe483b293efad/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:29.189888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5091dc-4ef4-4abc-b26d-34e458f8c3ed admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:29.204106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5091dc-4ef4-4abc-b26d-34e458f8c3ed admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:29.273748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192f771-570f-449a-93bb-24a572594819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:29.274356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192f771-570f-449a-93bb-24a572594819 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:29.274642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192f771-570f-449a-93bb-24a572594819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:29.274917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192f771-570f-449a-93bb-24a572594819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:29.275554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192f771-570f-449a-93bb-24a572594819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:29.277178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192f771-570f-449a-93bb-24a572594819 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:29.287221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1186/2396] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:29.291338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d12c48-8a25-44b4-9630-36ec95510ade admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:29.302290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d12c48-8a25-44b4-9630-36ec95510ade admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:29.306812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9a0c-5241-477b-a4cc-c4913127b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:29.307459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9a0c-5241-477b-a4cc-c4913127b434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:29.307733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9a0c-5241-477b-a4cc-c4913127b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:29.308001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9a0c-5241-477b-a4cc-c4913127b434 admin admin] PATH_INFO: `/v3/projects/53eca91b135b4b129b4f9fcfc476128e/users/8b4377291c214df4b00fe483b293efad/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:29.309905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c9a0c-5241-477b-a4cc-c4913127b434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53eca91b135b4b129b4f9fcfc476128e, user_id=8b4377291c214df4b00fe483b293efad, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:29.312513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c9a0c-5241-477b-a4cc-c4913127b434 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:29.323314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1211/2397] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:29 2022] PUT /identity/v3/projects/53eca91b135b4b129b4f9fcfc476128e/users/8b4377291c214df4b00fe483b293efad/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:29.333403 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf989cc-8c3c-4e53-b91e-7bec3b6b1163 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:29.333683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf989cc-8c3c-4e53-b91e-7bec3b6b1163 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:29.333957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf989cc-8c3c-4e53-b91e-7bec3b6b1163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:29.365277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-dbf989cc-8c3c-4e53-b91e-7bec3b6b1163 None None] MFA Rules not processed for user `8b4377291c214df4b00fe483b293efad`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:29.367097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dbf989cc-8c3c-4e53-b91e-7bec3b6b1163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:29.439344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1187/2398] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:29.450661 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9a0c-5241-477b-a4cc-c4913127b434 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:29.452524 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-487c9a0c-5241-477b-a4cc-c4913127b434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:29.511444 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9a0c-5241-477b-a4cc-c4913127b434 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:29.515161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd6f08-26c7-4ab7-8ea5-e5431ee4fe85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:29.515766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd6f08-26c7-4ab7-8ea5-e5431ee4fe85 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:29.516050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd6f08-26c7-4ab7-8ea5-e5431ee4fe85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:29.516326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd6f08-26c7-4ab7-8ea5-e5431ee4fe85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:29.526247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd6f08-26c7-4ab7-8ea5-e5431ee4fe85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:29.527672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd6f08-26c7-4ab7-8ea5-e5431ee4fe85 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:29.542131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1212/2399] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:29.612899 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf989cc-8c3c-4e53-b91e-7bec3b6b1163 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:29.634494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:29.682003 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf989cc-8c3c-4e53-b91e-7bec3b6b1163 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:29.687026 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:29.688287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:29.688567 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:29.688839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] PATH_INFO: `/v3/users/148d4cec9d624b5dbea57313ef06d232` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:29.690021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=148d4cec9d624b5dbea57313ef06d232)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:29.692232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:29.746668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148d4cec9d624b5dbea57313ef06d232'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:29.755584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148d4cec9d624b5dbea57313ef06d232'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:29.756584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148d4cec9d624b5dbea57313ef06d232'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:29.766947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148d4cec9d624b5dbea57313ef06d232'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:29.783666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148d4cec9d624b5dbea57313ef06d232'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:29.791849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1188/2400] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:40:29 2022] DELETE /identity/v3/users/148d4cec9d624b5dbea57313ef06d232 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:29.796491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9df4f-23f6-416e-9137-5a1d00efeae4 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:29.796776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9df4f-23f6-416e-9137-5a1d00efeae4 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:29.797082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9df4f-23f6-416e-9137-5a1d00efeae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:29.815901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-11d9df4f-23f6-416e-9137-5a1d00efeae4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:29.817251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-11d9df4f-23f6-416e-9137-5a1d00efeae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:29.881440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1213/2401] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:29.891272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:29.892788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:29.951170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab29927-9476-49ad-bbc9-f7f9b482d4e2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:29.954832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b184e24-fe67-4691-9b62-cfa7ccdbea4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:29.955503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184e24-fe67-4691-9b62-cfa7ccdbea4f service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:29.955779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184e24-fe67-4691-9b62-cfa7ccdbea4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:29.956046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184e24-fe67-4691-9b62-cfa7ccdbea4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:29.966541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b184e24-fe67-4691-9b62-cfa7ccdbea4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:29.967964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b184e24-fe67-4691-9b62-cfa7ccdbea4f service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:29.980155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1189/2402] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:30.249639 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9df4f-23f6-416e-9137-5a1d00efeae4 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:30.251497 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-11d9df4f-23f6-416e-9137-5a1d00efeae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:30.270499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9df4f-23f6-416e-9137-5a1d00efeae4 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:30.288566 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:30.289391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:30.289741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:30.290084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] PATH_INFO: `/v3/projects/6a2e36a9bb714b2a965ea7911f97291e` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:30.291475 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2e36a9bb714b2a965ea7911f97291e)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:30.293903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:30.347991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2e36a9bb714b2a965ea7911f97291e', 'request_id': 'req-d1ae6d56-c69e-4822-ba74-19e6a0c44370'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.358555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2e36a9bb714b2a965ea7911f97291e', 'request_id': 'req-d1ae6d56-c69e-4822-ba74-19e6a0c44370'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.365642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2e36a9bb714b2a965ea7911f97291e', 'request_id': 'req-d1ae6d56-c69e-4822-ba74-19e6a0c44370'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.368996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:30.382930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] The token cache is being invalidate because project 6a2e36a9bb714b2a965ea7911f97291e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:40:30.383122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.383587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.385097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1214/2403] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:40:30 2022] DELETE /identity/v3/projects/6a2e36a9bb714b2a965ea7911f97291e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:30.389320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b184e24-fe67-4691-9b62-cfa7ccdbea4f service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:30.399886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b184e24-fe67-4691-9b62-cfa7ccdbea4f service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:30.443882 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:30.463317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:30.463949 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:30.464233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:30.464504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] PATH_INFO: `/v3/users/8b4377291c214df4b00fe483b293efad` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:30.465646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4377291c214df4b00fe483b293efad)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:30.467537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:30.515546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4377291c214df4b00fe483b293efad'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.522229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4377291c214df4b00fe483b293efad'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.522892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4377291c214df4b00fe483b293efad'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.529923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4377291c214df4b00fe483b293efad'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.542000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-33c8ba01-19eb-4769-a118-407662e9cfb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4377291c214df4b00fe483b293efad'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.547942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1190/2404] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:40:30 2022] DELETE /identity/v3/users/8b4377291c214df4b00fe483b293efad => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:40:30.822021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:30.823515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:30.838997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae6d56-c69e-4822-ba74-19e6a0c44370 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:30.895462 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:30.896081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:30.896358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:30.896626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] PATH_INFO: `/v3/projects/53eca91b135b4b129b4f9fcfc476128e` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:30.897750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53eca91b135b4b129b4f9fcfc476128e)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:30.899676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:30.946027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53eca91b135b4b129b4f9fcfc476128e', 'request_id': 'req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.952360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53eca91b135b4b129b4f9fcfc476128e', 'request_id': 'req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.957968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53eca91b135b4b129b4f9fcfc476128e', 'request_id': 'req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.971378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] The token cache is being invalidate because project 53eca91b135b4b129b4f9fcfc476128e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:40:30.971674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.972830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7e4fdc96-fce2-4f05-a5d8-d2c4aeedd148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:30.975377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1215/2405] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:40:30 2022] DELETE /identity/v3/projects/53eca91b135b4b129b4f9fcfc476128e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:30.983604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4334df-67ee-485c-8789-6eed1ec0e6d1 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:30.983894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4334df-67ee-485c-8789-6eed1ec0e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:30.984178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4334df-67ee-485c-8789-6eed1ec0e6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:31.005756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ad4334df-67ee-485c-8789-6eed1ec0e6d1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:31.007008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ad4334df-67ee-485c-8789-6eed1ec0e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:31.066812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1191/2406] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:31.074588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ecc3-44e9-41f7-9d38-a1a650980de0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:31.074875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ecc3-44e9-41f7-9d38-a1a650980de0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:31.075151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ecc3-44e9-41f7-9d38-a1a650980de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:31.095168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4e38ecc3-44e9-41f7-9d38-a1a650980de0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:31.096364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4e38ecc3-44e9-41f7-9d38-a1a650980de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:31.104738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1216/2407] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:31.109038 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4334df-67ee-485c-8789-6eed1ec0e6d1 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:31.119077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4334df-67ee-485c-8789-6eed1ec0e6d1 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:31.125541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beb4ea-678a-4a30-a5e8-199bd99657bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:31.126147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beb4ea-678a-4a30-a5e8-199bd99657bc admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:31.126434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beb4ea-678a-4a30-a5e8-199bd99657bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:31.126713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beb4ea-678a-4a30-a5e8-199bd99657bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:31.127347 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19beb4ea-678a-4a30-a5e8-199bd99657bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:40:31.127650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19beb4ea-678a-4a30-a5e8-199bd99657bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:31.129283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19beb4ea-678a-4a30-a5e8-199bd99657bc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:31.141205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1192/2408] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:40:31.146249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38ecc3-44e9-41f7-9d38-a1a650980de0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:31.155357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38ecc3-44e9-41f7-9d38-a1a650980de0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:31.160569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e6ae1-a1a7-4068-8e45-48264755c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:31.161193 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e6ae1-a1a7-4068-8e45-48264755c515 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:31.161474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e6ae1-a1a7-4068-8e45-48264755c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:31.161747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e6ae1-a1a7-4068-8e45-48264755c515 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:31.162379 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e6ae1-a1a7-4068-8e45-48264755c515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:31.164250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e6ae1-a1a7-4068-8e45-48264755c515 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:31.191297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1217/2409] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:40:31 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:31.195477 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beb4ea-678a-4a30-a5e8-199bd99657bc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:31.205624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beb4ea-678a-4a30-a5e8-199bd99657bc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:31.249597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:31.262567 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74794-51de-43a4-8f3f-02b60e358932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:31.263147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74794-51de-43a4-8f3f-02b60e358932 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:31.263424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74794-51de-43a4-8f3f-02b60e358932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:31.263694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74794-51de-43a4-8f3f-02b60e358932 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:31.264314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c74794-51de-43a4-8f3f-02b60e358932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:31.266275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c74794-51de-43a4-8f3f-02b60e358932 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:31.290796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1193/2410] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:40:31 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:31.295186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e6ae1-a1a7-4068-8e45-48264755c515 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:31.305929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e6ae1-a1a7-4068-8e45-48264755c515 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:31.310585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e22deb-f18c-4c56-b400-27fef89e841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:31.311210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e22deb-f18c-4c56-b400-27fef89e841d admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:31.311488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e22deb-f18c-4c56-b400-27fef89e841d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:31.311760 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e22deb-f18c-4c56-b400-27fef89e841d admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:31.312397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e22deb-f18c-4c56-b400-27fef89e841d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:31.314042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e22deb-f18c-4c56-b400-27fef89e841d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:31.324090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1218/2411] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:31.328164 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74794-51de-43a4-8f3f-02b60e358932 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:31.338674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74794-51de-43a4-8f3f-02b60e358932 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:31.343266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dab50-ffd8-48e8-87fa-e3891127d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:31.343872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dab50-ffd8-48e8-87fa-e3891127d2ec admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:31.344141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dab50-ffd8-48e8-87fa-e3891127d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:31.344416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dab50-ffd8-48e8-87fa-e3891127d2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:31.345349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dab50-ffd8-48e8-87fa-e3891127d2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:31.346940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dab50-ffd8-48e8-87fa-e3891127d2ec admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:31.358094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1194/2412] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:31.362059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e22deb-f18c-4c56-b400-27fef89e841d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:31.372028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e22deb-f18c-4c56-b400-27fef89e841d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:31.376618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bb6c1-8c59-45fa-8e4b-6574794d576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:31.377303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb6c1-8c59-45fa-8e4b-6574794d576e admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:31.377579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb6c1-8c59-45fa-8e4b-6574794d576e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:31.377848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb6c1-8c59-45fa-8e4b-6574794d576e admin admin] PATH_INFO: `/v3/projects/eb684757bfb147c79c16b03b4de5c192/users/bb8595a48a104d16b60e984f519b1bca/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:31.393209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bb6c1-8c59-45fa-8e4b-6574794d576e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb684757bfb147c79c16b03b4de5c192, user_id=bb8595a48a104d16b60e984f519b1bca, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:31.396391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bb6c1-8c59-45fa-8e4b-6574794d576e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:31.409423 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1219/2413] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:31 2022] PUT /identity/v3/projects/eb684757bfb147c79c16b03b4de5c192/users/bb8595a48a104d16b60e984f519b1bca/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:31.420532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478e21-3316-4ff4-aa73-6107b82278db None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:31.421043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478e21-3316-4ff4-aa73-6107b82278db None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:31.421185 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478e21-3316-4ff4-aa73-6107b82278db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:31.449184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4a478e21-3316-4ff4-aa73-6107b82278db None None] MFA Rules not processed for user `bb8595a48a104d16b60e984f519b1bca`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:31.450400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4a478e21-3316-4ff4-aa73-6107b82278db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:31.543939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1195/2414] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:40:31.554949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bb6c1-8c59-45fa-8e4b-6574794d576e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:31.558058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7e1bb6c1-8c59-45fa-8e4b-6574794d576e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:31.595750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:31.644675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bb6c1-8c59-45fa-8e4b-6574794d576e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:31.648396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3826b49-f1ff-41c2-a03b-202c06ba87df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:31.649028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3826b49-f1ff-41c2-a03b-202c06ba87df service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:31.649310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3826b49-f1ff-41c2-a03b-202c06ba87df service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:31.649580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3826b49-f1ff-41c2-a03b-202c06ba87df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:31.659063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3826b49-f1ff-41c2-a03b-202c06ba87df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:31.661124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3826b49-f1ff-41c2-a03b-202c06ba87df service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:31.670834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1220/2415] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:40:34.742056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a478e21-3316-4ff4-aa73-6107b82278db None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:34.802929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a478e21-3316-4ff4-aa73-6107b82278db None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:34.807421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:34.808044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:34.808322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:34.808596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] PATH_INFO: `/v3/users/bb8595a48a104d16b60e984f519b1bca` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:34.809736 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8595a48a104d16b60e984f519b1bca)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:34.811648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:34.857437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8595a48a104d16b60e984f519b1bca'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:34.865390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8595a48a104d16b60e984f519b1bca'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:34.866063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8595a48a104d16b60e984f519b1bca'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:34.870447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:34.874159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8595a48a104d16b60e984f519b1bca'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:34.887181 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8595a48a104d16b60e984f519b1bca'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:34.893269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1196/2416] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:40:34 2022] DELETE /identity/v3/users/bb8595a48a104d16b60e984f519b1bca => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:34.897775 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a346527-d6bd-4097-91eb-23694d250998 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:34.898216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a346527-d6bd-4097-91eb-23694d250998 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:34.898311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a346527-d6bd-4097-91eb-23694d250998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:34.916619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4a346527-d6bd-4097-91eb-23694d250998 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:34.917853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4a346527-d6bd-4097-91eb-23694d250998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:34.978155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1221/2417] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:34.987931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:34.989431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:35.046898 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce93389-e626-462b-af9b-bf9a7700a5e8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:35.050655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fea644-eb18-4036-a411-208527134fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:35.051262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea644-eb18-4036-a411-208527134fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:35.051543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea644-eb18-4036-a411-208527134fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:35.051815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fea644-eb18-4036-a411-208527134fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:35.060825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fea644-eb18-4036-a411-208527134fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:35.062649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fea644-eb18-4036-a411-208527134fe1 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:35.072052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1197/2418] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:35.537201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a346527-d6bd-4097-91eb-23694d250998 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:35.537201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4a346527-d6bd-4097-91eb-23694d250998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:35.549690 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a346527-d6bd-4097-91eb-23694d250998 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:35.555985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:35.556650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:35.557508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:35.557791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] PATH_INFO: `/v3/projects/eb684757bfb147c79c16b03b4de5c192` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:35.559164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb684757bfb147c79c16b03b4de5c192)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:35.561169 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:35.624387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb684757bfb147c79c16b03b4de5c192', 'request_id': 'req-5285f08e-9db8-4b76-9660-1cb1c705de4a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:35.632406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb684757bfb147c79c16b03b4de5c192', 'request_id': 'req-5285f08e-9db8-4b76-9660-1cb1c705de4a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:35.639095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb684757bfb147c79c16b03b4de5c192', 'request_id': 'req-5285f08e-9db8-4b76-9660-1cb1c705de4a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:35.655529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] The token cache is being invalidate because project eb684757bfb147c79c16b03b4de5c192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:40:35.656048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:35.656883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5285f08e-9db8-4b76-9660-1cb1c705de4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:35.658632 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1222/2419] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:40:35 2022] DELETE /identity/v3/projects/eb684757bfb147c79c16b03b4de5c192 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:35.663835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce52e5c-1eb5-4897-83a0-6e6f8326c282 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:35.664056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce52e5c-1eb5-4897-83a0-6e6f8326c282 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:35.664331 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce52e5c-1eb5-4897-83a0-6e6f8326c282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:35.687475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0ce52e5c-1eb5-4897-83a0-6e6f8326c282 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:35.689123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0ce52e5c-1eb5-4897-83a0-6e6f8326c282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:35.763568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1198/2420] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:35.771871 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11c64-cfe0-433b-b3ef-2676de2f0883 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:35.772230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11c64-cfe0-433b-b3ef-2676de2f0883 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:35.772574 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11c64-cfe0-433b-b3ef-2676de2f0883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:35.792290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7ec11c64-cfe0-433b-b3ef-2676de2f0883 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:35.793624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7ec11c64-cfe0-433b-b3ef-2676de2f0883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:35.802136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1223/2421] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:35.807065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce52e5c-1eb5-4897-83a0-6e6f8326c282 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:35.816707 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce52e5c-1eb5-4897-83a0-6e6f8326c282 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:35.821487 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90eac4-f6c2-4138-80ca-f05444054cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:35.822195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90eac4-f6c2-4138-80ca-f05444054cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:35.822540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90eac4-f6c2-4138-80ca-f05444054cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:35.822879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90eac4-f6c2-4138-80ca-f05444054cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:35.823592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90eac4-f6c2-4138-80ca-f05444054cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:40:35.823966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90eac4-f6c2-4138-80ca-f05444054cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:35.825645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90eac4-f6c2-4138-80ca-f05444054cc9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:35.841099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1199/2422] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:40:35.842323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11c64-cfe0-433b-b3ef-2676de2f0883 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:35.853509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11c64-cfe0-433b-b3ef-2676de2f0883 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:35.858247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c306c-0421-4f3f-a462-9a0b302a1390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:35.858851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c306c-0421-4f3f-a462-9a0b302a1390 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:35.859133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c306c-0421-4f3f-a462-9a0b302a1390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:35.859410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c306c-0421-4f3f-a462-9a0b302a1390 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:35.860069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c306c-0421-4f3f-a462-9a0b302a1390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:35.862009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c306c-0421-4f3f-a462-9a0b302a1390 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:35.889642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1224/2423] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:40:35 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:35.893835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90eac4-f6c2-4138-80ca-f05444054cc9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:35.906221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90eac4-f6c2-4138-80ca-f05444054cc9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:35.974242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b751156-4b5d-45dc-9a3a-e8222dd79c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:35.974875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b751156-4b5d-45dc-9a3a-e8222dd79c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:35.975176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b751156-4b5d-45dc-9a3a-e8222dd79c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:35.975447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b751156-4b5d-45dc-9a3a-e8222dd79c7d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:35.976072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b751156-4b5d-45dc-9a3a-e8222dd79c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:35.978011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b751156-4b5d-45dc-9a3a-e8222dd79c7d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:35.989337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:36.001776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1200/2424] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:40:35 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:40:36.005848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c306c-0421-4f3f-a462-9a0b302a1390 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.016275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c306c-0421-4f3f-a462-9a0b302a1390 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.020875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690855c-9f96-4356-8f03-81c2cc35ffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.021535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690855c-9f96-4356-8f03-81c2cc35ffae admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.021902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690855c-9f96-4356-8f03-81c2cc35ffae admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.022191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690855c-9f96-4356-8f03-81c2cc35ffae admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.022851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690855c-9f96-4356-8f03-81c2cc35ffae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.024536 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690855c-9f96-4356-8f03-81c2cc35ffae admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.034656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1225/2425] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:36.038989 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b751156-4b5d-45dc-9a3a-e8222dd79c7d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.049007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b751156-4b5d-45dc-9a3a-e8222dd79c7d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.054240 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5e6c2-6787-42f5-9dde-670a4c1ca93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.054818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5e6c2-6787-42f5-9dde-670a4c1ca93d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.055094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5e6c2-6787-42f5-9dde-670a4c1ca93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.055361 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5e6c2-6787-42f5-9dde-670a4c1ca93d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.055991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5e6c2-6787-42f5-9dde-670a4c1ca93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.057673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5e6c2-6787-42f5-9dde-670a4c1ca93d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.068683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1201/2426] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:36.072780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690855c-9f96-4356-8f03-81c2cc35ffae admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.082663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690855c-9f96-4356-8f03-81c2cc35ffae admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.087251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8bc7-311a-41a2-9d69-0ff733105afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.087884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8bc7-311a-41a2-9d69-0ff733105afa admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.088166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8bc7-311a-41a2-9d69-0ff733105afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.088438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8bc7-311a-41a2-9d69-0ff733105afa admin admin] PATH_INFO: `/v3/projects/9f2fdab50f824af88ea9669332ab9708/users/c7cf4b9ca19e4dc5ba3d1bf2d59a66e0/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.090617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:36.106020 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8bc7-311a-41a2-9d69-0ff733105afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2fdab50f824af88ea9669332ab9708, user_id=c7cf4b9ca19e4dc5ba3d1bf2d59a66e0, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.108656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8bc7-311a-41a2-9d69-0ff733105afa admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.121488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1226/2427] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:36 2022] PUT /identity/v3/projects/9f2fdab50f824af88ea9669332ab9708/users/c7cf4b9ca19e4dc5ba3d1bf2d59a66e0/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:36.133319 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9d199-9858-4fef-a66e-505867aaf854 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.133623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9d199-9858-4fef-a66e-505867aaf854 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.133891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9d199-9858-4fef-a66e-505867aaf854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.161390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-29d9d199-9858-4fef-a66e-505867aaf854 None None] MFA Rules not processed for user `c7cf4b9ca19e4dc5ba3d1bf2d59a66e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:36.162576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-29d9d199-9858-4fef-a66e-505867aaf854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:36.225537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1202/2428] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:36.229947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8bc7-311a-41a2-9d69-0ff733105afa admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.290325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8bc7-311a-41a2-9d69-0ff733105afa admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.294960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfcac3-1f77-45c8-ac92-a6643468be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.295565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfcac3-1f77-45c8-ac92-a6643468be37 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.295842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfcac3-1f77-45c8-ac92-a6643468be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.296113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfcac3-1f77-45c8-ac92-a6643468be37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.296739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfcac3-1f77-45c8-ac92-a6643468be37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.298648 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfcac3-1f77-45c8-ac92-a6643468be37 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.325338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1227/2429] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:40:36 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:36.329444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9d199-9858-4fef-a66e-505867aaf854 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.339909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9d199-9858-4fef-a66e-505867aaf854 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.401723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa0256-c018-4de5-b51f-c8bef308f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.402321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa0256-c018-4de5-b51f-c8bef308f65d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.402605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa0256-c018-4de5-b51f-c8bef308f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.402880 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa0256-c018-4de5-b51f-c8bef308f65d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.403514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa0256-c018-4de5-b51f-c8bef308f65d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.405457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa0256-c018-4de5-b51f-c8bef308f65d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.427428 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1203/2430] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:40:36 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:36.431447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfcac3-1f77-45c8-ac92-a6643468be37 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.442419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfcac3-1f77-45c8-ac92-a6643468be37 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.447044 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7ca2e-2037-4a6c-bfdb-c511eb9f7415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.447639 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7ca2e-2037-4a6c-bfdb-c511eb9f7415 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.447917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7ca2e-2037-4a6c-bfdb-c511eb9f7415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.448185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7ca2e-2037-4a6c-bfdb-c511eb9f7415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.448817 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7ca2e-2037-4a6c-bfdb-c511eb9f7415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.450493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7ca2e-2037-4a6c-bfdb-c511eb9f7415 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.460779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1228/2431] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:36.464516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa0256-c018-4de5-b51f-c8bef308f65d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.474500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa0256-c018-4de5-b51f-c8bef308f65d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.479172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc941b-e7bc-4cc1-8d8b-d95348547df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.479695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc941b-e7bc-4cc1-8d8b-d95348547df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.479971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc941b-e7bc-4cc1-8d8b-d95348547df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.480239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc941b-e7bc-4cc1-8d8b-d95348547df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.480869 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc941b-e7bc-4cc1-8d8b-d95348547df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.482453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc941b-e7bc-4cc1-8d8b-d95348547df3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.492577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1204/2432] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:36.496465 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7ca2e-2037-4a6c-bfdb-c511eb9f7415 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.506926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7ca2e-2037-4a6c-bfdb-c511eb9f7415 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.511538 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f651f-2b54-4395-b060-2b4b3fa00c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.512204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f651f-2b54-4395-b060-2b4b3fa00c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.512484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f651f-2b54-4395-b060-2b4b3fa00c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.512757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f651f-2b54-4395-b060-2b4b3fa00c26 admin admin] PATH_INFO: `/v3/projects/4b89f192b4d64ffda331ea85f5483ad4/users/ea682ac602e6436fba1f883b12f1039f/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.526998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f651f-2b54-4395-b060-2b4b3fa00c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b89f192b4d64ffda331ea85f5483ad4, user_id=ea682ac602e6436fba1f883b12f1039f, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.529669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f651f-2b54-4395-b060-2b4b3fa00c26 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.542081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1229/2433] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:36 2022] PUT /identity/v3/projects/4b89f192b4d64ffda331ea85f5483ad4/users/ea682ac602e6436fba1f883b12f1039f/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:36.553614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2345bb-ca88-439c-b9c3-9fa4d25cb59a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.553907 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2345bb-ca88-439c-b9c3-9fa4d25cb59a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.554203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2345bb-ca88-439c-b9c3-9fa4d25cb59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.582774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ff2345bb-ca88-439c-b9c3-9fa4d25cb59a None None] MFA Rules not processed for user `ea682ac602e6436fba1f883b12f1039f`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:36.583987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ff2345bb-ca88-439c-b9c3-9fa4d25cb59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:36.627116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:36.654879 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1205/2434] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:40:36.659325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f651f-2b54-4395-b060-2b4b3fa00c26 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.730680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f651f-2b54-4395-b060-2b4b3fa00c26 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.735761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e56a1e-1a8e-47aa-9260-3e30ec62fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.735932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e56a1e-1a8e-47aa-9260-3e30ec62fc67 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.736157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e56a1e-1a8e-47aa-9260-3e30ec62fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.736427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e56a1e-1a8e-47aa-9260-3e30ec62fc67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.737088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e56a1e-1a8e-47aa-9260-3e30ec62fc67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.739614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e56a1e-1a8e-47aa-9260-3e30ec62fc67 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.765935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1230/2435] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:40:36 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:40:36.770100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2345bb-ca88-439c-b9c3-9fa4d25cb59a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.780838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2345bb-ca88-439c-b9c3-9fa4d25cb59a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.838320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bc579-37b5-42dc-9e54-3dd70673986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.838940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bc579-37b5-42dc-9e54-3dd70673986b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.839225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bc579-37b5-42dc-9e54-3dd70673986b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.839496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bc579-37b5-42dc-9e54-3dd70673986b admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.840136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bc579-37b5-42dc-9e54-3dd70673986b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.842110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bc579-37b5-42dc-9e54-3dd70673986b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.868186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1206/2436] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:40:36 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:40:36.869888 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e56a1e-1a8e-47aa-9260-3e30ec62fc67 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.880707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e56a1e-1a8e-47aa-9260-3e30ec62fc67 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.885398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a847-7c4e-40ba-b46b-a4c8a6e80b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.885992 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a847-7c4e-40ba-b46b-a4c8a6e80b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.886274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a847-7c4e-40ba-b46b-a4c8a6e80b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.886550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a847-7c4e-40ba-b46b-a4c8a6e80b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.887186 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07a847-7c4e-40ba-b46b-a4c8a6e80b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.888771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07a847-7c4e-40ba-b46b-a4c8a6e80b76 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.900835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1231/2437] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:36.904990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bc579-37b5-42dc-9e54-3dd70673986b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.915003 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bc579-37b5-42dc-9e54-3dd70673986b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.919679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0cb4e-be71-42e0-bd4c-8b4001b42350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:36.920329 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0cb4e-be71-42e0-bd4c-8b4001b42350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:36.920641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0cb4e-be71-42e0-bd4c-8b4001b42350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:36.920916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0cb4e-be71-42e0-bd4c-8b4001b42350 admin admin] PATH_INFO: `/v3/projects/d283da3b069b45c8bcd911798dbb461e/users/30edd5425f83403b836fd8827e3120ab/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:36.937291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0cb4e-be71-42e0-bd4c-8b4001b42350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d283da3b069b45c8bcd911798dbb461e, user_id=30edd5425f83403b836fd8827e3120ab, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:36.940023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0cb4e-be71-42e0-bd4c-8b4001b42350 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:36.953261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1207/2438] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:36 2022] PUT /identity/v3/projects/d283da3b069b45c8bcd911798dbb461e/users/30edd5425f83403b836fd8827e3120ab/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:36.957704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a847-7c4e-40ba-b46b-a4c8a6e80b76 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:36.970310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a847-7c4e-40ba-b46b-a4c8a6e80b76 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:36.975130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:37.030168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c2acb-2a7f-41a5-a8d9-5c1987b7fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:37.030795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c2acb-2a7f-41a5-a8d9-5c1987b7fd6e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:37.030947 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c2acb-2a7f-41a5-a8d9-5c1987b7fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:37.031212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c2acb-2a7f-41a5-a8d9-5c1987b7fd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:37.032139 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c2acb-2a7f-41a5-a8d9-5c1987b7fd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:37.033545 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c2acb-2a7f-41a5-a8d9-5c1987b7fd6e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:37.043347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1232/2439] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:40:37.047504 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0cb4e-be71-42e0-bd4c-8b4001b42350 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:37.058051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0cb4e-be71-42e0-bd4c-8b4001b42350 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:37.062629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3607f0-d5fa-4e12-9823-ab32050ae6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:37.063262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3607f0-d5fa-4e12-9823-ab32050ae6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:37.063536 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3607f0-d5fa-4e12-9823-ab32050ae6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:37.063814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3607f0-d5fa-4e12-9823-ab32050ae6ac admin admin] PATH_INFO: `/v3/projects/d283da3b069b45c8bcd911798dbb461e/users/30edd5425f83403b836fd8827e3120ab/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:37.065716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3607f0-d5fa-4e12-9823-ab32050ae6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d283da3b069b45c8bcd911798dbb461e, user_id=30edd5425f83403b836fd8827e3120ab, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:37.068933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3607f0-d5fa-4e12-9823-ab32050ae6ac admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:37.078724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1208/2440] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:40:37 2022] PUT /identity/v3/projects/d283da3b069b45c8bcd911798dbb461e/users/30edd5425f83403b836fd8827e3120ab/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:37.088510 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed4dff-691c-4e7c-a3f9-d3bc42f27887 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:37.088805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed4dff-691c-4e7c-a3f9-d3bc42f27887 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:37.089119 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed4dff-691c-4e7c-a3f9-d3bc42f27887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:37.116643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-c7ed4dff-691c-4e7c-a3f9-d3bc42f27887 None None] MFA Rules not processed for user `30edd5425f83403b836fd8827e3120ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:37.117888 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c7ed4dff-691c-4e7c-a3f9-d3bc42f27887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:37.185916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1233/2441] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:40:37.197122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3607f0-d5fa-4e12-9823-ab32050ae6ac admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:37.198842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9d3607f0-d5fa-4e12-9823-ab32050ae6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:37.258428 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3607f0-d5fa-4e12-9823-ab32050ae6ac admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:37.262346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49240acf-77b5-4208-b4a0-f583537a6a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:37.262946 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49240acf-77b5-4208-b4a0-f583537a6a5d service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:37.263223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49240acf-77b5-4208-b4a0-f583537a6a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:37.263680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49240acf-77b5-4208-b4a0-f583537a6a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:37.316358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:37.326817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49240acf-77b5-4208-b4a0-f583537a6a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:37.328238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49240acf-77b5-4208-b4a0-f583537a6a5d service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:37.338002 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1209/2442] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:38.832354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed4dff-691c-4e7c-a3f9-d3bc42f27887 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:38.833807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c7ed4dff-691c-4e7c-a3f9-d3bc42f27887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:38.845647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed4dff-691c-4e7c-a3f9-d3bc42f27887 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:38.849938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eefb50-84f9-400c-be88-7ab78252ba66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:38.850545 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eefb50-84f9-400c-be88-7ab78252ba66 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:38.850826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eefb50-84f9-400c-be88-7ab78252ba66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:38.851098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eefb50-84f9-400c-be88-7ab78252ba66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:38.905935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eefb50-84f9-400c-be88-7ab78252ba66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:38.907268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eefb50-84f9-400c-be88-7ab78252ba66 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:38.916986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1234/2443] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:39.533187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49240acf-77b5-4208-b4a0-f583537a6a5d service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:39.542121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49240acf-77b5-4208-b4a0-f583537a6a5d service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:39.545865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5d7da-b79f-4e58-b03b-d491db9c36e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:39.546457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5d7da-b79f-4e58-b03b-d491db9c36e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:39.546737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5d7da-b79f-4e58-b03b-d491db9c36e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:39.547007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5d7da-b79f-4e58-b03b-d491db9c36e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:39.555995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5d7da-b79f-4e58-b03b-d491db9c36e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:39.557452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5d7da-b79f-4e58-b03b-d491db9c36e4 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:39.567147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1210/2444] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:43.451709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eefb50-84f9-400c-be88-7ab78252ba66 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:43.483073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:43.561555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eefb50-84f9-400c-be88-7ab78252ba66 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:43.565996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:43.567146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:43.567424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:43.567692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] PATH_INFO: `/v3/users/c7cf4b9ca19e4dc5ba3d1bf2d59a66e0` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:43.568811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7cf4b9ca19e4dc5ba3d1bf2d59a66e0)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:43.570846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:43.615719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7cf4b9ca19e4dc5ba3d1bf2d59a66e0'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:43.616368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7cf4b9ca19e4dc5ba3d1bf2d59a66e0'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:43.623238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7cf4b9ca19e4dc5ba3d1bf2d59a66e0'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:43.635659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7cf4b9ca19e4dc5ba3d1bf2d59a66e0'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:43.636301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7cf4b9ca19e4dc5ba3d1bf2d59a66e0'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:43.649259 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1235/2445] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:40:43 2022] DELETE /identity/v3/users/c7cf4b9ca19e4dc5ba3d1bf2d59a66e0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:43.652173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24658b1f-1dc2-45a4-8807-934f151204b4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:43.652625 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24658b1f-1dc2-45a4-8807-934f151204b4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:43.652793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24658b1f-1dc2-45a4-8807-934f151204b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:43.702434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-24658b1f-1dc2-45a4-8807-934f151204b4 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:43.703670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-24658b1f-1dc2-45a4-8807-934f151204b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:43.768980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1211/2446] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:43.780553 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:43.782142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:43.855856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:43.859973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53547bc3-57de-49e9-8ec5-9372687078fc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:43.864405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583d508-ceec-4d83-9b01-0dba962ad024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:43.865039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583d508-ceec-4d83-9b01-0dba962ad024 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:43.865735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583d508-ceec-4d83-9b01-0dba962ad024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:43.866067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583d508-ceec-4d83-9b01-0dba962ad024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:43.875911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583d508-ceec-4d83-9b01-0dba962ad024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:43.877348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583d508-ceec-4d83-9b01-0dba962ad024 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:43.887134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1236/2447] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:40:44.163499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24658b1f-1dc2-45a4-8807-934f151204b4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:44.164966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-24658b1f-1dc2-45a4-8807-934f151204b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:44.178159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24658b1f-1dc2-45a4-8807-934f151204b4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:44.183140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:44.183769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:44.184060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:44.184315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] PATH_INFO: `/v3/projects/9f2fdab50f824af88ea9669332ab9708` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:44.185461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2fdab50f824af88ea9669332ab9708)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:44.187350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:44.234156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2fdab50f824af88ea9669332ab9708', 'request_id': 'req-8f5387bf-3a33-4e0b-a01b-f18a0c236476'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.240306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2fdab50f824af88ea9669332ab9708', 'request_id': 'req-8f5387bf-3a33-4e0b-a01b-f18a0c236476'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.245925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2fdab50f824af88ea9669332ab9708', 'request_id': 'req-8f5387bf-3a33-4e0b-a01b-f18a0c236476'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.258463 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] The token cache is being invalidate because project 9f2fdab50f824af88ea9669332ab9708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:40:44.258781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.259407 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.260870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1212/2448] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:40:44 2022] DELETE /identity/v3/projects/9f2fdab50f824af88ea9669332ab9708 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:44.264964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583d508-ceec-4d83-9b01-0dba962ad024 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:44.275185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583d508-ceec-4d83-9b01-0dba962ad024 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:44.329989 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:44.330608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:44.330911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:44.331183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] PATH_INFO: `/v3/users/ea682ac602e6436fba1f883b12f1039f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:44.332372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea682ac602e6436fba1f883b12f1039f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:44.334283 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:44.382071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea682ac602e6436fba1f883b12f1039f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.382725 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea682ac602e6436fba1f883b12f1039f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.389552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea682ac602e6436fba1f883b12f1039f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.401208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea682ac602e6436fba1f883b12f1039f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.401841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea682ac602e6436fba1f883b12f1039f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.414952 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1237/2449] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:40:44 2022] DELETE /identity/v3/users/ea682ac602e6436fba1f883b12f1039f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:44.696056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:44.697542 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:44.713522 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5387bf-3a33-4e0b-a01b-f18a0c236476 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:44.745452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:44.772900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:44.773551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:44.773837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:44.774111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] PATH_INFO: `/v3/projects/4b89f192b4d64ffda331ea85f5483ad4` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:44.775222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b89f192b4d64ffda331ea85f5483ad4)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:44.777161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:44.822468 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b89f192b4d64ffda331ea85f5483ad4', 'request_id': 'req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.828645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b89f192b4d64ffda331ea85f5483ad4', 'request_id': 'req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.834752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b89f192b4d64ffda331ea85f5483ad4', 'request_id': 'req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.846974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] The token cache is being invalidate because project 4b89f192b4d64ffda331ea85f5483ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:40:44.847265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.847877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.849397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1213/2450] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:40:44 2022] DELETE /identity/v3/projects/4b89f192b4d64ffda331ea85f5483ad4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:44.853338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:44.854774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:44.867725 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f5520-1c43-428f-a474-f7c4e91c12e4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:44.925852 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:44.926703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:44.926824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:44.927017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] PATH_INFO: `/v3/users/30edd5425f83403b836fd8827e3120ab` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:44.928316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30edd5425f83403b836fd8827e3120ab)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:44.930269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:44.944042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:44.979865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30edd5425f83403b836fd8827e3120ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.980517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30edd5425f83403b836fd8827e3120ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:44.987637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30edd5425f83403b836fd8827e3120ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:45.001565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30edd5425f83403b836fd8827e3120ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:45.002264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0929acb9-fbcc-4f44-85a3-884228b6ede6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30edd5425f83403b836fd8827e3120ab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:45.015637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1238/2451] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:40:44 2022] DELETE /identity/v3/users/30edd5425f83403b836fd8827e3120ab => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:40:45.281783 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:45.283310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:45.296356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd1f9e-072c-49af-9aa4-a8c3aa698d73 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:45.353951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:45.354591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:45.354893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:45.355166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] PATH_INFO: `/v3/projects/d283da3b069b45c8bcd911798dbb461e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:45.356279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d283da3b069b45c8bcd911798dbb461e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:45.358231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:45.403338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd283da3b069b45c8bcd911798dbb461e', 'request_id': 'req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:45.409251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd283da3b069b45c8bcd911798dbb461e', 'request_id': 'req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:45.415418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd283da3b069b45c8bcd911798dbb461e', 'request_id': 'req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:45.417907 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:45.428371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] The token cache is being invalidate because project d283da3b069b45c8bcd911798dbb461e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:40:45.428861 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:45.429535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:40:45.430994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1214/2452] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:40:45 2022] DELETE /identity/v3/projects/d283da3b069b45c8bcd911798dbb461e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:40:49.281244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea288856-689d-410a-bcee-88dcb14fa91d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:49.281718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea288856-689d-410a-bcee-88dcb14fa91d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:49.281823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea288856-689d-410a-bcee-88dcb14fa91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:49.311143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ea288856-689d-410a-bcee-88dcb14fa91d None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:40:49.312386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ea288856-689d-410a-bcee-88dcb14fa91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:49.378996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1239/2453] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:40:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:40:49.427399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:40:49.428815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:40:49.515915 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad4e49-16fd-4960-b9e0-24a99b4e8de5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:40:49.521678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ceb768-d8ea-47ee-ae5b-4eb014e73386 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:40:49.522291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceb768-d8ea-47ee-ae5b-4eb014e73386 service swift] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:40:49.522575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceb768-d8ea-47ee-ae5b-4eb014e73386 service swift] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:40:49.522851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceb768-d8ea-47ee-ae5b-4eb014e73386 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:40:49.533639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceb768-d8ea-47ee-ae5b-4eb014e73386 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:40:49.536801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceb768-d8ea-47ee-ae5b-4eb014e73386 service swift] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:40:49.545314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1215/2454] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:40:59.372010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=54,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:59.541851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=1,keystone:SELECT=34 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:05.235484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f33920-4882-4ce9-932d-b1e140dbe1e2 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:05.236032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f33920-4882-4ce9-932d-b1e140dbe1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:05.236192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f33920-4882-4ce9-932d-b1e140dbe1e2 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:05.237586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1240/2455] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:41:05.244305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee25d2d-7cf1-4f9a-b76d-508d76474344 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:05.244774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee25d2d-7cf1-4f9a-b76d-508d76474344 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:05.245039 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee25d2d-7cf1-4f9a-b76d-508d76474344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:05.289304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cee25d2d-7cf1-4f9a-b76d-508d76474344 None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:41:05.290526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cee25d2d-7cf1-4f9a-b76d-508d76474344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:41:05.374274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1216/2456] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:41:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:41:05.385688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f33920-4882-4ce9-932d-b1e140dbe1e2 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:41:05.387375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a6f33920-4882-4ce9-932d-b1e140dbe1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:41:05.445709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f33920-4882-4ce9-932d-b1e140dbe1e2 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:41:05.449227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05601746-38d5-4dc5-89ea-90e0548a05eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfef506919f4914a7883bd99ea07615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:41:05.449823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05601746-38d5-4dc5-89ea-90e0548a05eb service glance] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:05.450101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05601746-38d5-4dc5-89ea-90e0548a05eb service glance] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:05.450369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05601746-38d5-4dc5-89ea-90e0548a05eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:05.460656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05601746-38d5-4dc5-89ea-90e0548a05eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:41:05.462102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05601746-38d5-4dc5-89ea-90e0548a05eb service glance] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:41:05.472813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1241/2457] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:41:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:41:05.542149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1f6b2-87a1-4e6c-89fa-52006b29dbae None None] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:05.542432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1f6b2-87a1-4e6c-89fa-52006b29dbae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:05.542704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1f6b2-87a1-4e6c-89fa-52006b29dbae None None] PATH_INFO: `/` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:05.544065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1217/2458] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:41:05.548535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe22de6-ba53-4817-8249-0966aa484987 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:05.548824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe22de6-ba53-4817-8249-0966aa484987 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:05.549137 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe22de6-ba53-4817-8249-0966aa484987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:05.579463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-dfe22de6-ba53-4817-8249-0966aa484987 None None] MFA Rules not processed for user `ad0f25125b534983af66d5326f4d626d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:41:05.580636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-dfe22de6-ba53-4817-8249-0966aa484987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:41:05.639847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1242/2459] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:41:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:41:05.652337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1f6b2-87a1-4e6c-89fa-52006b29dbae None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:41:05.654035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4ff1f6b2-87a1-4e6c-89fa-52006b29dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:41:05.667317 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1f6b2-87a1-4e6c-89fa-52006b29dbae None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:41:05.670789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5f58-d4da-42a6-8eb3-f7294e87859e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:41:05.671369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5f58-d4da-42a6-8eb3-f7294e87859e service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:05.671644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5f58-d4da-42a6-8eb3-f7294e87859e service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:05.671912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5f58-d4da-42a6-8eb3-f7294e87859e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:05.679260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b5f58-d4da-42a6-8eb3-f7294e87859e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:41:05.680682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b5f58-d4da-42a6-8eb3-f7294e87859e service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:41:05.688210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1218/2460] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:41:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:41:05.772619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5250d81-c900-4c25-8982-428ef19b3512 None None] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:05.773014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5250d81-c900-4c25-8982-428ef19b3512 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:05.773297 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5250d81-c900-4c25-8982-428ef19b3512 None None] PATH_INFO: `/` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:05.774643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1243/2461] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 10:41:05.779437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75073a-20de-4c68-9057-efb563d70c68 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:05.779721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75073a-20de-4c68-9057-efb563d70c68 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:05.779990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75073a-20de-4c68-9057-efb563d70c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:05.799140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3f75073a-20de-4c68-9057-efb563d70c68 None None] MFA Rules not processed for user `e58300ef26a547028e837ba2da615991`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:41:05.800326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3f75073a-20de-4c68-9057-efb563d70c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:41:05.809476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1219/2462] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 10:41:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:41:05.820031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5250d81-c900-4c25-8982-428ef19b3512 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:41:05.821708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e5250d81-c900-4c25-8982-428ef19b3512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:41:05.835203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5250d81-c900-4c25-8982-428ef19b3512 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:41:05.838849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2369a-7cef-4f60-a21f-244dce734e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:41:05.839432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2369a-7cef-4f60-a21f-244dce734e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:05.839710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2369a-7cef-4f60-a21f-244dce734e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:05.839983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2369a-7cef-4f60-a21f-244dce734e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:05.850124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2369a-7cef-4f60-a21f-244dce734e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:41:05.851518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2369a-7cef-4f60-a21f-244dce734e0a service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:41:05.861960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1244/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:41:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:41:07.710589 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cf394-e40e-412e-8b43-c9cd5858b1c7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:07.711036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cf394-e40e-412e-8b43-c9cd5858b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:07.711136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cf394-e40e-412e-8b43-c9cd5858b1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:07.731039 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ee7cf394-e40e-412e-8b43-c9cd5858b1c7 None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:41:07.732226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ee7cf394-e40e-412e-8b43-c9cd5858b1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:41:07.739338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1220/2464] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 10:41:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:41:07.751144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2369a-7cef-4f60-a21f-244dce734e0a service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:41:07.762164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2369a-7cef-4f60-a21f-244dce734e0a service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:41:07.767113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850c37-c988-4c17-81d1-acaea79ef5f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:41:07.767700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850c37-c988-4c17-81d1-acaea79ef5f2 service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:07.767977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850c37-c988-4c17-81d1-acaea79ef5f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:07.768247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850c37-c988-4c17-81d1-acaea79ef5f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:07.776551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30850c37-c988-4c17-81d1-acaea79ef5f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:41:07.778208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30850c37-c988-4c17-81d1-acaea79ef5f2 service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:41:07.786691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1245/2465] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:41:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 10:41:17.725698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=56 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:17.782909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=70 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:30.333216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59acdc-0317-46f3-81a3-7aa1abb64184 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:30.333681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59acdc-0317-46f3-81a3-7aa1abb64184 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:30.333774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59acdc-0317-46f3-81a3-7aa1abb64184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:30.352911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-5e59acdc-0317-46f3-81a3-7aa1abb64184 None None] MFA Rules not processed for user `ecdfe8d98368455db8b67097051b9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:41:30.354129 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5e59acdc-0317-46f3-81a3-7aa1abb64184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:41:30.361361 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1221/2466] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 10:41:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:41:30.374272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850c37-c988-4c17-81d1-acaea79ef5f2 service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:41:30.387704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850c37-c988-4c17-81d1-acaea79ef5f2 service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:41:30.392935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af37f1-81af-485a-825c-9eda16021f93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b380b92dc5438c92380c3fe2406590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:41:30.393554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af37f1-81af-485a-825c-9eda16021f93 service swift] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:30.393835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af37f1-81af-485a-825c-9eda16021f93 service swift] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:30.394107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af37f1-81af-485a-825c-9eda16021f93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:30.402168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af37f1-81af-485a-825c-9eda16021f93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:41:30.403720 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af37f1-81af-485a-825c-9eda16021f93 service swift] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:41:30.412132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1246/2467] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 10:41:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 10:41:40.347710 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:40.408462 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:54.283109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59acdc-0317-46f3-81a3-7aa1abb64184 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:41:54.284530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-5e59acdc-0317-46f3-81a3-7aa1abb64184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:41:54.375545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59acdc-0317-46f3-81a3-7aa1abb64184 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:41:54.380681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25741db4-8934-49a6-8656-da19ee366495 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:41:54.381348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25741db4-8934-49a6-8656-da19ee366495 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:41:54.381627 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25741db4-8934-49a6-8656-da19ee366495 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:41:54.381929 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25741db4-8934-49a6-8656-da19ee366495 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:41:54.383668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-25741db4-8934-49a6-8656-da19ee366495 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:41:54.395213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25741db4-8934-49a6-8656-da19ee366495 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:41:54.396825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25741db4-8934-49a6-8656-da19ee366495 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:41:54.406823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1222/2468] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:41:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:00.402655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af37f1-81af-485a-825c-9eda16021f93 service swift] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:00.411973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af37f1-81af-485a-825c-9eda16021f93 service swift] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:00.415662 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584c11e-83ae-49e8-8f41-bb9037356a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:00.416246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c11e-83ae-49e8-8f41-bb9037356a9a service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:00.416521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c11e-83ae-49e8-8f41-bb9037356a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:00.416792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c11e-83ae-49e8-8f41-bb9037356a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:00.418549 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4584c11e-83ae-49e8-8f41-bb9037356a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:00.480262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584c11e-83ae-49e8-8f41-bb9037356a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:00.481777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584c11e-83ae-49e8-8f41-bb9037356a9a service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:00.491309 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1247/2469] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:03.500563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25741db4-8934-49a6-8656-da19ee366495 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:03.502044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-25741db4-8934-49a6-8656-da19ee366495 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:03.515330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25741db4-8934-49a6-8656-da19ee366495 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:03.520604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce753043-f21e-4573-a38b-e8bc04bc840f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:03.521265 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce753043-f21e-4573-a38b-e8bc04bc840f service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:03.521744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce753043-f21e-4573-a38b-e8bc04bc840f service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:03.522179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce753043-f21e-4573-a38b-e8bc04bc840f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:03.524293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ce753043-f21e-4573-a38b-e8bc04bc840f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:03.537837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce753043-f21e-4573-a38b-e8bc04bc840f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:03.539425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce753043-f21e-4573-a38b-e8bc04bc840f service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:03.549459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1223/2470] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:03.571751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584c11e-83ae-49e8-8f41-bb9037356a9a service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:03.573200 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4584c11e-83ae-49e8-8f41-bb9037356a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:03.586329 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584c11e-83ae-49e8-8f41-bb9037356a9a service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:03.593641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:03.594287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:03.594567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:03.594843 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] PATH_INFO: `/v3/users/beee7ecbe9554a46a6be476aa5b2ef51` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:03.595962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beee7ecbe9554a46a6be476aa5b2ef51)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:03.597910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:03.645288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beee7ecbe9554a46a6be476aa5b2ef51'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:03.645867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beee7ecbe9554a46a6be476aa5b2ef51'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:03.652896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beee7ecbe9554a46a6be476aa5b2ef51'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:03.665256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beee7ecbe9554a46a6be476aa5b2ef51'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:03.665885 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e3557377-b2f0-4808-9592-a79fdb0df4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beee7ecbe9554a46a6be476aa5b2ef51'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:03.679166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1248/2471] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:03 2022] DELETE /identity/v3/users/beee7ecbe9554a46a6be476aa5b2ef51 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:03.864387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce753043-f21e-4573-a38b-e8bc04bc840f service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:03.877891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce753043-f21e-4573-a38b-e8bc04bc840f service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:03.934835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:03.935378 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:03.935655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:03.935925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] PATH_INFO: `/v3/projects/4f2b5c30b896413abff90c2529a1d2ea` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:03.937048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2b5c30b896413abff90c2529a1d2ea)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:03.938926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:03.984017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2b5c30b896413abff90c2529a1d2ea', 'request_id': 'req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:03.990586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2b5c30b896413abff90c2529a1d2ea', 'request_id': 'req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:03.994523 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:03.996652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2b5c30b896413abff90c2529a1d2ea', 'request_id': 'req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:04.009262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] The token cache is being invalidate because project 4f2b5c30b896413abff90c2529a1d2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:04.009572 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:04.010203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-595f7bf4-7e15-4ca4-afc2-54c96ad5d48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:04.011672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1224/2472] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:03 2022] DELETE /identity/v3/projects/4f2b5c30b896413abff90c2529a1d2ea => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:04.016589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc83c7-0b58-4037-8544-9c53c20b26d9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:04.016875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc83c7-0b58-4037-8544-9c53c20b26d9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:04.017182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc83c7-0b58-4037-8544-9c53c20b26d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:04.056153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-54fc83c7-0b58-4037-8544-9c53c20b26d9 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:04.057398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-54fc83c7-0b58-4037-8544-9c53c20b26d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:04.101948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:04.118412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1249/2473] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:04.126275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3e250-987a-4a22-8f7e-c4d2e4c7fb38 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:04.126565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3e250-987a-4a22-8f7e-c4d2e4c7fb38 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:04.126842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3e250-987a-4a22-8f7e-c4d2e4c7fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:04.147275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-80b3e250-987a-4a22-8f7e-c4d2e4c7fb38 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:04.148484 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-80b3e250-987a-4a22-8f7e-c4d2e4c7fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:04.156346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1225/2474] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:04.160833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc83c7-0b58-4037-8544-9c53c20b26d9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:04.171152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc83c7-0b58-4037-8544-9c53c20b26d9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:04.177635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b1eb-688c-4925-b545-6f7e96aa931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:04.178242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b1eb-688c-4925-b545-6f7e96aa931e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:04.178687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b1eb-688c-4925-b545-6f7e96aa931e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:04.179209 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b1eb-688c-4925-b545-6f7e96aa931e admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:04.179872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b1eb-688c-4925-b545-6f7e96aa931e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:42:04.180185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b1eb-688c-4925-b545-6f7e96aa931e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:04.182571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b1eb-688c-4925-b545-6f7e96aa931e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:04.195893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1250/2475] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:42:04.199600 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3e250-987a-4a22-8f7e-c4d2e4c7fb38 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:04.208724 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3e250-987a-4a22-8f7e-c4d2e4c7fb38 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:04.214157 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060519e-ae7a-4f4c-a57e-ae7d77af1fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:04.214746 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060519e-ae7a-4f4c-a57e-ae7d77af1fed admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:04.215022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060519e-ae7a-4f4c-a57e-ae7d77af1fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:04.215291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060519e-ae7a-4f4c-a57e-ae7d77af1fed admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:04.215907 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060519e-ae7a-4f4c-a57e-ae7d77af1fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:04.217857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060519e-ae7a-4f4c-a57e-ae7d77af1fed admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:04.244281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1226/2476] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:04 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:04.248431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b1eb-688c-4925-b545-6f7e96aa931e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:04.258994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b1eb-688c-4925-b545-6f7e96aa931e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:04.314963 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f0528-ecef-4f51-9443-fe951d7d9058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:04.315856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f0528-ecef-4f51-9443-fe951d7d9058 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:04.316284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f0528-ecef-4f51-9443-fe951d7d9058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:04.316736 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f0528-ecef-4f51-9443-fe951d7d9058 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:04.317392 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f0528-ecef-4f51-9443-fe951d7d9058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:04.319806 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f0528-ecef-4f51-9443-fe951d7d9058 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:04.340816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1251/2477] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:04 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:04.344742 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060519e-ae7a-4f4c-a57e-ae7d77af1fed admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:04.355718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060519e-ae7a-4f4c-a57e-ae7d77af1fed admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:04.360327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f9b15-11ca-41a2-8883-95f916a944f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:04.360919 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f9b15-11ca-41a2-8883-95f916a944f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:04.361226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f9b15-11ca-41a2-8883-95f916a944f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:04.361497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f9b15-11ca-41a2-8883-95f916a944f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:04.362150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f9b15-11ca-41a2-8883-95f916a944f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:04.363822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f9b15-11ca-41a2-8883-95f916a944f8 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:04.376501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1227/2478] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:42:04.380435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f0528-ecef-4f51-9443-fe951d7d9058 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:04.390252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f0528-ecef-4f51-9443-fe951d7d9058 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:04.394887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d6897-ea45-4628-9120-4f0c1bf3abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:04.395474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d6897-ea45-4628-9120-4f0c1bf3abc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:04.395754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d6897-ea45-4628-9120-4f0c1bf3abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:04.396030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d6897-ea45-4628-9120-4f0c1bf3abc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:04.396693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d6897-ea45-4628-9120-4f0c1bf3abc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:04.398298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d6897-ea45-4628-9120-4f0c1bf3abc2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:04.408787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1252/2479] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:04.413130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f9b15-11ca-41a2-8883-95f916a944f8 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:04.423971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f9b15-11ca-41a2-8883-95f916a944f8 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:04.428877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13570e-fbd8-4a88-8d37-22604b86fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:04.429557 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13570e-fbd8-4a88-8d37-22604b86fc63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:04.429856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13570e-fbd8-4a88-8d37-22604b86fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:04.430110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13570e-fbd8-4a88-8d37-22604b86fc63 admin admin] PATH_INFO: `/v3/projects/213795727db4478daed1dd20684dc10c/users/0058c16b253a4b07b0f36e32abb84207/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:04.444795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13570e-fbd8-4a88-8d37-22604b86fc63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=213795727db4478daed1dd20684dc10c, user_id=0058c16b253a4b07b0f36e32abb84207, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:04.447506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13570e-fbd8-4a88-8d37-22604b86fc63 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:04.459896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1228/2480] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:04 2022] PUT /identity/v3/projects/213795727db4478daed1dd20684dc10c/users/0058c16b253a4b07b0f36e32abb84207/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:04.475712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169443-9525-4b62-98fd-1eb69d61d576 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:04.475994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169443-9525-4b62-98fd-1eb69d61d576 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:04.476263 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169443-9525-4b62-98fd-1eb69d61d576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:04.503084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-e8169443-9525-4b62-98fd-1eb69d61d576 None None] MFA Rules not processed for user `0058c16b253a4b07b0f36e32abb84207`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:04.504273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-e8169443-9525-4b62-98fd-1eb69d61d576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:04.567109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1253/2481] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:04.578846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13570e-fbd8-4a88-8d37-22604b86fc63 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:04.580518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1f13570e-fbd8-4a88-8d37-22604b86fc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:04.651409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13570e-fbd8-4a88-8d37-22604b86fc63 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:04.656868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ac07d-7e33-44ee-8e7e-2fd6a6dcba94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:04.657487 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ac07d-7e33-44ee-8e7e-2fd6a6dcba94 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:04.657764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ac07d-7e33-44ee-8e7e-2fd6a6dcba94 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:04.658034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ac07d-7e33-44ee-8e7e-2fd6a6dcba94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:04.665531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ac07d-7e33-44ee-8e7e-2fd6a6dcba94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:04.667083 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ac07d-7e33-44ee-8e7e-2fd6a6dcba94 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:04.675626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1229/2482] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:09.860457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169443-9525-4b62-98fd-1eb69d61d576 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:09.905955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:09.923146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169443-9525-4b62-98fd-1eb69d61d576 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:09.928078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:09.928766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:09.929107 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:09.929386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] PATH_INFO: `/v3/users/0058c16b253a4b07b0f36e32abb84207` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:09.930509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0058c16b253a4b07b0f36e32abb84207)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:09.932422 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:09.981588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0058c16b253a4b07b0f36e32abb84207'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:09.982269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0058c16b253a4b07b0f36e32abb84207'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:09.989504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0058c16b253a4b07b0f36e32abb84207'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:10.002415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0058c16b253a4b07b0f36e32abb84207'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:10.002997 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0058c16b253a4b07b0f36e32abb84207'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:10.016448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1254/2483] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:09 2022] DELETE /identity/v3/users/0058c16b253a4b07b0f36e32abb84207 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:10.021382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88f4ea-6041-4c69-a1da-8ac3a7725f37 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.022033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88f4ea-6041-4c69-a1da-8ac3a7725f37 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.022033 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88f4ea-6041-4c69-a1da-8ac3a7725f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.041631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bc88f4ea-6041-4c69-a1da-8ac3a7725f37 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:10.042807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bc88f4ea-6041-4c69-a1da-8ac3a7725f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:10.099553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1230/2484] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:10.109397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:10.110772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:10.168552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d53d2-82d9-4d62-b722-2457bd5fab54 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:10.172106 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de89e24-d80a-4038-a364-2aa2dfbd384d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:10.172707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de89e24-d80a-4038-a364-2aa2dfbd384d service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.173005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de89e24-d80a-4038-a364-2aa2dfbd384d service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.173279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de89e24-d80a-4038-a364-2aa2dfbd384d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.182979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de89e24-d80a-4038-a364-2aa2dfbd384d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:10.184438 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de89e24-d80a-4038-a364-2aa2dfbd384d service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:10.193753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1255/2485] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:10.460278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88f4ea-6041-4c69-a1da-8ac3a7725f37 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:10.461790 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bc88f4ea-6041-4c69-a1da-8ac3a7725f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:10.475545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88f4ea-6041-4c69-a1da-8ac3a7725f37 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:10.481668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:10.482318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.482595 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.482861 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] PATH_INFO: `/v3/projects/213795727db4478daed1dd20684dc10c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.484599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=213795727db4478daed1dd20684dc10c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:10.486945 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:10.489488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:10.546216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213795727db4478daed1dd20684dc10c', 'request_id': 'req-2fb2c20b-d749-4a3a-8880-c93080975302'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:10.552369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213795727db4478daed1dd20684dc10c', 'request_id': 'req-2fb2c20b-d749-4a3a-8880-c93080975302'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:10.558384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213795727db4478daed1dd20684dc10c', 'request_id': 'req-2fb2c20b-d749-4a3a-8880-c93080975302'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:10.571937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] The token cache is being invalidate because project 213795727db4478daed1dd20684dc10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:10.572262 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:10.572882 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2fb2c20b-d749-4a3a-8880-c93080975302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:10.574421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1231/2486] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:10 2022] DELETE /identity/v3/projects/213795727db4478daed1dd20684dc10c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:10.579376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac450f6-2302-4126-bcad-b25afbb5e057 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.579666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac450f6-2302-4126-bcad-b25afbb5e057 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.579965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac450f6-2302-4126-bcad-b25afbb5e057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.599126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cac450f6-2302-4126-bcad-b25afbb5e057 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:10.600352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cac450f6-2302-4126-bcad-b25afbb5e057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:10.660039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1256/2487] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:10.667867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c1094-28df-4e2a-8593-3427a4c73cdc None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.668226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c1094-28df-4e2a-8593-3427a4c73cdc None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.668571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c1094-28df-4e2a-8593-3427a4c73cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.688815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-4e7c1094-28df-4e2a-8593-3427a4c73cdc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:10.690043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4e7c1094-28df-4e2a-8593-3427a4c73cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:10.698481 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1232/2488] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:10.702842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac450f6-2302-4126-bcad-b25afbb5e057 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:10.712529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac450f6-2302-4126-bcad-b25afbb5e057 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:10.717131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e8dc-0789-4abd-9e0d-1c2c486c384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:10.717726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e8dc-0789-4abd-9e0d-1c2c486c384a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.718003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e8dc-0789-4abd-9e0d-1c2c486c384a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.718274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e8dc-0789-4abd-9e0d-1c2c486c384a admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.718910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e8dc-0789-4abd-9e0d-1c2c486c384a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:42:10.719210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e8dc-0789-4abd-9e0d-1c2c486c384a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:10.720777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e8dc-0789-4abd-9e0d-1c2c486c384a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:10.723144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:10.734850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1257/2489] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:42:10.738734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c1094-28df-4e2a-8593-3427a4c73cdc None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:10.748274 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c1094-28df-4e2a-8593-3427a4c73cdc None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:10.752875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e73cc-cf77-4737-ae2f-18ab3a07c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:10.753537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e73cc-cf77-4737-ae2f-18ab3a07c9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.753820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e73cc-cf77-4737-ae2f-18ab3a07c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.754087 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e73cc-cf77-4737-ae2f-18ab3a07c9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.754706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e73cc-cf77-4737-ae2f-18ab3a07c9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:10.757221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e73cc-cf77-4737-ae2f-18ab3a07c9e3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:10.782892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1233/2490] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:10 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:10.787003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e8dc-0789-4abd-9e0d-1c2c486c384a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:10.797363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e8dc-0789-4abd-9e0d-1c2c486c384a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:10.857908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fa021-abad-47f9-8c65-979dda3b928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:10.858512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fa021-abad-47f9-8c65-979dda3b928b admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.858787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fa021-abad-47f9-8c65-979dda3b928b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.859059 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fa021-abad-47f9-8c65-979dda3b928b admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.859679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fa021-abad-47f9-8c65-979dda3b928b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:10.861644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fa021-abad-47f9-8c65-979dda3b928b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:10.887268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1258/2491] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:10 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:10.888703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e73cc-cf77-4737-ae2f-18ab3a07c9e3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:10.899898 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e73cc-cf77-4737-ae2f-18ab3a07c9e3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:10.904645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba14d5-7ada-4bc5-9624-2304eddacdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:10.905286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba14d5-7ada-4bc5-9624-2304eddacdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.905576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba14d5-7ada-4bc5-9624-2304eddacdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.905860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba14d5-7ada-4bc5-9624-2304eddacdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.906501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba14d5-7ada-4bc5-9624-2304eddacdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:10.908089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba14d5-7ada-4bc5-9624-2304eddacdf3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:10.919186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1234/2492] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:10.923253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fa021-abad-47f9-8c65-979dda3b928b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:10.934824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fa021-abad-47f9-8c65-979dda3b928b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:10.939508 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1e2b9-d0ea-4f53-8a48-8e355f568bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:10.940085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1e2b9-d0ea-4f53-8a48-8e355f568bab admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.940363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1e2b9-d0ea-4f53-8a48-8e355f568bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.940630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1e2b9-d0ea-4f53-8a48-8e355f568bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.941294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1e2b9-d0ea-4f53-8a48-8e355f568bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:10.942892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1e2b9-d0ea-4f53-8a48-8e355f568bab admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:10.954555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1259/2493] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:10.958942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba14d5-7ada-4bc5-9624-2304eddacdf3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:10.969161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba14d5-7ada-4bc5-9624-2304eddacdf3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:10.974494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a0f9-ef33-4b50-be93-5f5e26954afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:10.976085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a0f9-ef33-4b50-be93-5f5e26954afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:10.976486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a0f9-ef33-4b50-be93-5f5e26954afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:10.976876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a0f9-ef33-4b50-be93-5f5e26954afe admin admin] PATH_INFO: `/v3/projects/9f20720ee7e441dda2c97caa2d7195ce/users/5ffadefac35546ab8b7daef3302f0bb8/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:10.992413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5a0f9-ef33-4b50-be93-5f5e26954afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f20720ee7e441dda2c97caa2d7195ce, user_id=5ffadefac35546ab8b7daef3302f0bb8, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:10.995098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5a0f9-ef33-4b50-be93-5f5e26954afe admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:11.009197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1235/2494] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:10 2022] PUT /identity/v3/projects/9f20720ee7e441dda2c97caa2d7195ce/users/5ffadefac35546ab8b7daef3302f0bb8/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:11.021063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0ba22-519f-4538-90b2-111b667ad60b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:11.021356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0ba22-519f-4538-90b2-111b667ad60b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:11.021677 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0ba22-519f-4538-90b2-111b667ad60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:11.050121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3de0ba22-519f-4538-90b2-111b667ad60b None None] MFA Rules not processed for user `5ffadefac35546ab8b7daef3302f0bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:11.051338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3de0ba22-519f-4538-90b2-111b667ad60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:11.120308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1260/2495] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:11.124603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a0f9-ef33-4b50-be93-5f5e26954afe admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:11.187799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a0f9-ef33-4b50-be93-5f5e26954afe admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:11.192364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ca522-f224-4d02-86d0-207942f18f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:11.192991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ca522-f224-4d02-86d0-207942f18f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:11.193280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ca522-f224-4d02-86d0-207942f18f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:11.194088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ca522-f224-4d02-86d0-207942f18f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:11.194706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ca522-f224-4d02-86d0-207942f18f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:11.196604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ca522-f224-4d02-86d0-207942f18f59 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:11.222906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1236/2496] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:11 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:11.227752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0ba22-519f-4538-90b2-111b667ad60b None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:11.238241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0ba22-519f-4538-90b2-111b667ad60b None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:11.292400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc51a-4c6d-42b9-a238-a5905a9394c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:11.293014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc51a-4c6d-42b9-a238-a5905a9394c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:11.293345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc51a-4c6d-42b9-a238-a5905a9394c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:11.293616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc51a-4c6d-42b9-a238-a5905a9394c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:11.294220 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bc51a-4c6d-42b9-a238-a5905a9394c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:11.296098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bc51a-4c6d-42b9-a238-a5905a9394c4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:11.306304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:11.318208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1261/2497] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:11 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:11.323139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ca522-f224-4d02-86d0-207942f18f59 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:11.333544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ca522-f224-4d02-86d0-207942f18f59 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:11.338084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938ef0-f05b-430b-b2d6-f68f7e79186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:11.338655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938ef0-f05b-430b-b2d6-f68f7e79186b admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:11.338934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938ef0-f05b-430b-b2d6-f68f7e79186b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:11.339205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938ef0-f05b-430b-b2d6-f68f7e79186b admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:11.339835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5938ef0-f05b-430b-b2d6-f68f7e79186b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:11.341455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5938ef0-f05b-430b-b2d6-f68f7e79186b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:11.351797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1237/2498] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:11.356046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc51a-4c6d-42b9-a238-a5905a9394c4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:11.367349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc51a-4c6d-42b9-a238-a5905a9394c4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:11.372007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb09c6-4260-4f2e-a87b-fac747b0070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:11.372702 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb09c6-4260-4f2e-a87b-fac747b0070f admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:11.373008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb09c6-4260-4f2e-a87b-fac747b0070f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:11.373288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb09c6-4260-4f2e-a87b-fac747b0070f admin admin] PATH_INFO: `/v3/projects/24124f6fadb14dbd8861ff08af0daf4f/users/71f6c9eb19da45c2839600d2caf7fcc5/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:11.388539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb09c6-4260-4f2e-a87b-fac747b0070f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24124f6fadb14dbd8861ff08af0daf4f, user_id=71f6c9eb19da45c2839600d2caf7fcc5, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:11.391232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb09c6-4260-4f2e-a87b-fac747b0070f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:11.404062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1262/2499] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:11 2022] PUT /identity/v3/projects/24124f6fadb14dbd8861ff08af0daf4f/users/71f6c9eb19da45c2839600d2caf7fcc5/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:11.407965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938ef0-f05b-430b-b2d6-f68f7e79186b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:11.413306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:11.419820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938ef0-f05b-430b-b2d6-f68f7e79186b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:11.476458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf952f44-093f-475c-b333-13bda6addc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:11.477013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952f44-093f-475c-b333-13bda6addc7b admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:11.477295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952f44-093f-475c-b333-13bda6addc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:11.477568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952f44-093f-475c-b333-13bda6addc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:11.478201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf952f44-093f-475c-b333-13bda6addc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:11.479788 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf952f44-093f-475c-b333-13bda6addc7b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:11.489184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1238/2500] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:11.493294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb09c6-4260-4f2e-a87b-fac747b0070f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:11.503241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb09c6-4260-4f2e-a87b-fac747b0070f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:11.507758 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8a1a7-2038-42d8-896b-d93cde47063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:11.508393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8a1a7-2038-42d8-896b-d93cde47063f admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:11.508673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8a1a7-2038-42d8-896b-d93cde47063f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:11.508961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8a1a7-2038-42d8-896b-d93cde47063f admin admin] PATH_INFO: `/v3/projects/24124f6fadb14dbd8861ff08af0daf4f/users/71f6c9eb19da45c2839600d2caf7fcc5/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:11.510870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8a1a7-2038-42d8-896b-d93cde47063f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24124f6fadb14dbd8861ff08af0daf4f, user_id=71f6c9eb19da45c2839600d2caf7fcc5, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:11.513511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8a1a7-2038-42d8-896b-d93cde47063f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:11.523885 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1263/2501] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:11 2022] PUT /identity/v3/projects/24124f6fadb14dbd8861ff08af0daf4f/users/71f6c9eb19da45c2839600d2caf7fcc5/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:11.534377 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf015d1-2132-4df1-8d4e-5be61b42c057 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:11.534667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf015d1-2132-4df1-8d4e-5be61b42c057 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:11.534946 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf015d1-2132-4df1-8d4e-5be61b42c057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:11.563202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bcf015d1-2132-4df1-8d4e-5be61b42c057 None None] MFA Rules not processed for user `71f6c9eb19da45c2839600d2caf7fcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:11.564438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bcf015d1-2132-4df1-8d4e-5be61b42c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:11.630407 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1239/2502] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:11.642268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8a1a7-2038-42d8-896b-d93cde47063f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:11.644003 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-06b8a1a7-2038-42d8-896b-d93cde47063f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:11.720404 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8a1a7-2038-42d8-896b-d93cde47063f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:11.724406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57c3b-f97e-4f43-9a75-4267e5cd1ac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:11.725469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57c3b-f97e-4f43-9a75-4267e5cd1ac7 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:11.726004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57c3b-f97e-4f43-9a75-4267e5cd1ac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:11.726278 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57c3b-f97e-4f43-9a75-4267e5cd1ac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:11.735633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d57c3b-f97e-4f43-9a75-4267e5cd1ac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:11.737079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d57c3b-f97e-4f43-9a75-4267e5cd1ac7 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:11.747210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1264/2503] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:11.821075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf015d1-2132-4df1-8d4e-5be61b42c057 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:11.822531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bcf015d1-2132-4df1-8d4e-5be61b42c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:11.834524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf015d1-2132-4df1-8d4e-5be61b42c057 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:11.838216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74232ba-c9c8-4993-a8dd-e3baf8d0225d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:11.838805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74232ba-c9c8-4993-a8dd-e3baf8d0225d service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:11.839085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74232ba-c9c8-4993-a8dd-e3baf8d0225d service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:11.839358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74232ba-c9c8-4993-a8dd-e3baf8d0225d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:11.898450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74232ba-c9c8-4993-a8dd-e3baf8d0225d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:11.899889 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74232ba-c9c8-4993-a8dd-e3baf8d0225d service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:11.909060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1240/2504] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:19.006382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57c3b-f97e-4f43-9a75-4267e5cd1ac7 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:19.076125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57c3b-f97e-4f43-9a75-4267e5cd1ac7 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:19.080684 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:19.081371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:19.081649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:19.081918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] PATH_INFO: `/v3/users/5ffadefac35546ab8b7daef3302f0bb8` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:19.083061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffadefac35546ab8b7daef3302f0bb8)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:19.085224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:19.144740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:INSERT=3,keystone:SELECT=91,keystone:DELETE=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:19.150539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffadefac35546ab8b7daef3302f0bb8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:19.151176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffadefac35546ab8b7daef3302f0bb8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:19.159559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffadefac35546ab8b7daef3302f0bb8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:19.172830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffadefac35546ab8b7daef3302f0bb8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:19.173573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffadefac35546ab8b7daef3302f0bb8'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:19.188585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1265/2505] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:19 2022] DELETE /identity/v3/users/5ffadefac35546ab8b7daef3302f0bb8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:19.193088 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbdc15-a69f-40ff-a859-1fa76fb03ec6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:19.194089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbdc15-a69f-40ff-a859-1fa76fb03ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:19.194357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbdc15-a69f-40ff-a859-1fa76fb03ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:19.219466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-3fbbdc15-a69f-40ff-a859-1fa76fb03ec6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:19.221399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3fbbdc15-a69f-40ff-a859-1fa76fb03ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:19.249898 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:19.302865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1241/2506] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:19.313521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:19.314959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:19.404289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ff3f9-8c71-4070-965e-f9d6291f9745 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:19.407935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae5cb8-8fd0-49a7-b99b-9b0d3bcbaee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:19.408546 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5cb8-8fd0-49a7-b99b-9b0d3bcbaee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:19.408830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5cb8-8fd0-49a7-b99b-9b0d3bcbaee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:19.409141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5cb8-8fd0-49a7-b99b-9b0d3bcbaee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:19.423024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae5cb8-8fd0-49a7-b99b-9b0d3bcbaee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:19.424640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae5cb8-8fd0-49a7-b99b-9b0d3bcbaee2 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:19.436036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1266/2507] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:19.884071 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbdc15-a69f-40ff-a859-1fa76fb03ec6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:19.886015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3fbbdc15-a69f-40ff-a859-1fa76fb03ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:19.899926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbdc15-a69f-40ff-a859-1fa76fb03ec6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:19.905472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:19.906109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:19.906390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:19.906660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] PATH_INFO: `/v3/projects/9f20720ee7e441dda2c97caa2d7195ce` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:19.908346 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f20720ee7e441dda2c97caa2d7195ce)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:19.910517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:19.963248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f20720ee7e441dda2c97caa2d7195ce', 'request_id': 'req-abc97137-a64a-420c-a03e-fa9ad3d49515'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:19.969496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f20720ee7e441dda2c97caa2d7195ce', 'request_id': 'req-abc97137-a64a-420c-a03e-fa9ad3d49515'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:19.975424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f20720ee7e441dda2c97caa2d7195ce', 'request_id': 'req-abc97137-a64a-420c-a03e-fa9ad3d49515'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:19.989015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] The token cache is being invalidate because project 9f20720ee7e441dda2c97caa2d7195ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:19.989307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:19.989958 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-abc97137-a64a-420c-a03e-fa9ad3d49515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:19.992048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1242/2508] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:19 2022] DELETE /identity/v3/projects/9f20720ee7e441dda2c97caa2d7195ce => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:19.996168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae5cb8-8fd0-49a7-b99b-9b0d3bcbaee2 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:20.006061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae5cb8-8fd0-49a7-b99b-9b0d3bcbaee2 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:20.069841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:20.070522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:20.070904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:20.071280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] PATH_INFO: `/v3/users/71f6c9eb19da45c2839600d2caf7fcc5` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:20.072783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f6c9eb19da45c2839600d2caf7fcc5)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:20.074747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:20.121711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f6c9eb19da45c2839600d2caf7fcc5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:20.123047 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f6c9eb19da45c2839600d2caf7fcc5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:20.130965 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f6c9eb19da45c2839600d2caf7fcc5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:20.137421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:20.146614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f6c9eb19da45c2839600d2caf7fcc5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:20.147548 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f6c9eb19da45c2839600d2caf7fcc5'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:20.161178 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1267/2509] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:19 2022] DELETE /identity/v3/users/71f6c9eb19da45c2839600d2caf7fcc5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:42:20.330903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e0179-4123-46f0-adf5-083c4e2a3112 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:20.331599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e0179-4123-46f0-adf5-083c4e2a3112 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:20.332050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e0179-4123-46f0-adf5-083c4e2a3112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:20.361018 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-894e0179-4123-46f0-adf5-083c4e2a3112 None None] MFA Rules not processed for user `79deff91d5c046c4bbe7b2e47b21ba66`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:20.362465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-894e0179-4123-46f0-adf5-083c4e2a3112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:20.426800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1243/2510] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:20.457833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:20.459624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:20.531043 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72143098-7329-436c-9003-64e41b7649f2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:20.536640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:20.537331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:20.537687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:20.537961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] PATH_INFO: `/v3/projects/24124f6fadb14dbd8861ff08af0daf4f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:20.539111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24124f6fadb14dbd8861ff08af0daf4f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:20.541029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:20.590627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24124f6fadb14dbd8861ff08af0daf4f', 'request_id': 'req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:20.596994 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24124f6fadb14dbd8861ff08af0daf4f', 'request_id': 'req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:20.603301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24124f6fadb14dbd8861ff08af0daf4f', 'request_id': 'req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:20.618826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] The token cache is being invalidate because project 24124f6fadb14dbd8861ff08af0daf4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:20.619116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:20.619731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-ee4474d9-7cf2-4fd2-ac3b-6ef72a5aa13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:20.621253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1268/2511] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:20 2022] DELETE /identity/v3/projects/24124f6fadb14dbd8861ff08af0daf4f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:20.626185 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58311-456e-410d-afd0-33bf5ec1a2f2 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:20.626524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58311-456e-410d-afd0-33bf5ec1a2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:20.626807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58311-456e-410d-afd0-33bf5ec1a2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:20.646126 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d9e58311-456e-410d-afd0-33bf5ec1a2f2 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:20.647363 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d9e58311-456e-410d-afd0-33bf5ec1a2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:20.691530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:20.708571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1244/2512] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:20.716841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc2c4-9a9a-4331-90bf-89675083f9f9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:20.717160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc2c4-9a9a-4331-90bf-89675083f9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:20.717441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc2c4-9a9a-4331-90bf-89675083f9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:20.738899 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-969bc2c4-9a9a-4331-90bf-89675083f9f9 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:20.740099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-969bc2c4-9a9a-4331-90bf-89675083f9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:20.748196 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1269/2513] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:20.752410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e58311-456e-410d-afd0-33bf5ec1a2f2 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:20.762876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e58311-456e-410d-afd0-33bf5ec1a2f2 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:20.767569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98805a-d6b9-4cba-aa00-e4cc8ef1003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:20.768162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98805a-d6b9-4cba-aa00-e4cc8ef1003c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:20.768438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98805a-d6b9-4cba-aa00-e4cc8ef1003c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:20.768706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98805a-d6b9-4cba-aa00-e4cc8ef1003c admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:20.769486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98805a-d6b9-4cba-aa00-e4cc8ef1003c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:42:20.769797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98805a-d6b9-4cba-aa00-e4cc8ef1003c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:20.771366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98805a-d6b9-4cba-aa00-e4cc8ef1003c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:20.783201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1245/2514] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:42:20.788195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bc2c4-9a9a-4331-90bf-89675083f9f9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:20.797521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bc2c4-9a9a-4331-90bf-89675083f9f9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:20.802146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1130678-946a-4f72-b787-3cd34dcecb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:20.802741 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130678-946a-4f72-b787-3cd34dcecb0d admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:20.803124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130678-946a-4f72-b787-3cd34dcecb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:20.803403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130678-946a-4f72-b787-3cd34dcecb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:20.804034 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1130678-946a-4f72-b787-3cd34dcecb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:20.805938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1130678-946a-4f72-b787-3cd34dcecb0d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:20.835222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1270/2515] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:20 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:20.837325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98805a-d6b9-4cba-aa00-e4cc8ef1003c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:20.848117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98805a-d6b9-4cba-aa00-e4cc8ef1003c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:20.904524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a989ccf-c0ac-4892-a5c7-05dda069374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:20.905328 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a989ccf-c0ac-4892-a5c7-05dda069374e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:20.905631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a989ccf-c0ac-4892-a5c7-05dda069374e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:20.905904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a989ccf-c0ac-4892-a5c7-05dda069374e admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:20.906650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a989ccf-c0ac-4892-a5c7-05dda069374e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:20.908869 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a989ccf-c0ac-4892-a5c7-05dda069374e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:20.931636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1246/2516] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:20 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:20.936199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1130678-946a-4f72-b787-3cd34dcecb0d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:20.946286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1130678-946a-4f72-b787-3cd34dcecb0d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:20.950919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb04b4-d1d5-4743-9b16-6bd3ffd1e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:20.951523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb04b4-d1d5-4743-9b16-6bd3ffd1e5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:20.951804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb04b4-d1d5-4743-9b16-6bd3ffd1e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:20.952073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb04b4-d1d5-4743-9b16-6bd3ffd1e5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:20.952799 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb04b4-d1d5-4743-9b16-6bd3ffd1e5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:20.954725 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb04b4-d1d5-4743-9b16-6bd3ffd1e5a9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:20.966633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1271/2517] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:20.970359 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a989ccf-c0ac-4892-a5c7-05dda069374e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:20.981232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a989ccf-c0ac-4892-a5c7-05dda069374e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:20.985865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2a1fb-741d-4fa9-b7ca-1b70ef92c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:20.986453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a1fb-741d-4fa9-b7ca-1b70ef92c7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:20.986734 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a1fb-741d-4fa9-b7ca-1b70ef92c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:20.987009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a1fb-741d-4fa9-b7ca-1b70ef92c7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:20.987655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a1fb-741d-4fa9-b7ca-1b70ef92c7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:20.989715 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a1fb-741d-4fa9-b7ca-1b70ef92c7bf admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:21.000119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1247/2518] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:21.004250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb04b4-d1d5-4743-9b16-6bd3ffd1e5a9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:21.015503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb04b4-d1d5-4743-9b16-6bd3ffd1e5a9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:21.020710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ebc4-b84a-4f40-8a87-4187145198e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:21.021507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ebc4-b84a-4f40-8a87-4187145198e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:21.021886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ebc4-b84a-4f40-8a87-4187145198e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:21.022778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ebc4-b84a-4f40-8a87-4187145198e8 admin admin] PATH_INFO: `/v3/projects/f5720ee3d8c749dea5be739d8d733fbe/users/57c11c4a36804cbca6515f168a297d52/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:21.042924 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ebc4-b84a-4f40-8a87-4187145198e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5720ee3d8c749dea5be739d8d733fbe, user_id=57c11c4a36804cbca6515f168a297d52, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:21.046282 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ebc4-b84a-4f40-8a87-4187145198e8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:21.060121 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1272/2519] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:21 2022] PUT /identity/v3/projects/f5720ee3d8c749dea5be739d8d733fbe/users/57c11c4a36804cbca6515f168a297d52/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:42:21.072828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1f57b-3c55-43a3-a46a-429ef14a9756 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:21.072828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1f57b-3c55-43a3-a46a-429ef14a9756 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:21.073059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1f57b-3c55-43a3-a46a-429ef14a9756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:21.102551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8ca1f57b-3c55-43a3-a46a-429ef14a9756 None None] MFA Rules not processed for user `57c11c4a36804cbca6515f168a297d52`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:21.104079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8ca1f57b-3c55-43a3-a46a-429ef14a9756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:21.181009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1248/2520] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:21.185845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ebc4-b84a-4f40-8a87-4187145198e8 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:21.195370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:21.250529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ebc4-b84a-4f40-8a87-4187145198e8 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:21.255668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474557-c402-49dd-a8cc-e535964920de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:21.256447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474557-c402-49dd-a8cc-e535964920de admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:21.256735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474557-c402-49dd-a8cc-e535964920de admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:21.257157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5474557-c402-49dd-a8cc-e535964920de admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:21.257824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5474557-c402-49dd-a8cc-e535964920de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:21.259860 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5474557-c402-49dd-a8cc-e535964920de admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:21.294621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1273/2521] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:21 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:21.295727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1f57b-3c55-43a3-a46a-429ef14a9756 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:21.306288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1f57b-3c55-43a3-a46a-429ef14a9756 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:21.353831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:21.371894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c9fe3-7a5c-418d-affd-b529461da002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:21.372513 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c9fe3-7a5c-418d-affd-b529461da002 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:21.372794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c9fe3-7a5c-418d-affd-b529461da002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:21.373105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c9fe3-7a5c-418d-affd-b529461da002 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:21.373744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c9fe3-7a5c-418d-affd-b529461da002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:21.375698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c9fe3-7a5c-418d-affd-b529461da002 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:21.397340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1249/2522] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:21 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:21.401435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474557-c402-49dd-a8cc-e535964920de admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:21.413238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5474557-c402-49dd-a8cc-e535964920de admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:21.418227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d4400-b66f-42ef-8610-a5dc901c1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:21.418827 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d4400-b66f-42ef-8610-a5dc901c1dec admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:21.419111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d4400-b66f-42ef-8610-a5dc901c1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:21.419387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d4400-b66f-42ef-8610-a5dc901c1dec admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:21.420023 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d4400-b66f-42ef-8610-a5dc901c1dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:21.421651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d4400-b66f-42ef-8610-a5dc901c1dec admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:21.434923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1274/2523] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:42:21.438979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c9fe3-7a5c-418d-affd-b529461da002 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:21.449961 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c9fe3-7a5c-418d-affd-b529461da002 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:21.454751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c735b8-9a49-4cf5-9e94-dad6f7a77c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:21.455400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c735b8-9a49-4cf5-9e94-dad6f7a77c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:21.455681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c735b8-9a49-4cf5-9e94-dad6f7a77c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:21.455953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c735b8-9a49-4cf5-9e94-dad6f7a77c6e admin admin] PATH_INFO: `/v3/projects/29f10e1473e94e0dbd4f8cc684803a45/users/af32d16403a242edb7b3689df308e8e2/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:21.472069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c735b8-9a49-4cf5-9e94-dad6f7a77c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f10e1473e94e0dbd4f8cc684803a45, user_id=af32d16403a242edb7b3689df308e8e2, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:21.474750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c735b8-9a49-4cf5-9e94-dad6f7a77c6e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:21.491712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1250/2524] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:21 2022] PUT /identity/v3/projects/29f10e1473e94e0dbd4f8cc684803a45/users/af32d16403a242edb7b3689df308e8e2/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:21.495582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d4400-b66f-42ef-8610-a5dc901c1dec admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:21.505869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d4400-b66f-42ef-8610-a5dc901c1dec admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:21.569260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c40816-b29b-418b-aa7b-f991281a7210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:21.569894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c40816-b29b-418b-aa7b-f991281a7210 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:21.570161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c40816-b29b-418b-aa7b-f991281a7210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:21.570437 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c40816-b29b-418b-aa7b-f991281a7210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:21.571080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c40816-b29b-418b-aa7b-f991281a7210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:21.572669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c40816-b29b-418b-aa7b-f991281a7210 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:21.582756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1275/2525] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:21.586896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c735b8-9a49-4cf5-9e94-dad6f7a77c6e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:21.596979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c735b8-9a49-4cf5-9e94-dad6f7a77c6e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:21.602890 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d3e0e-3f05-48f4-a4e7-3abbb188269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:21.603611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d3e0e-3f05-48f4-a4e7-3abbb188269f admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:21.603897 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d3e0e-3f05-48f4-a4e7-3abbb188269f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:21.604172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d3e0e-3f05-48f4-a4e7-3abbb188269f admin admin] PATH_INFO: `/v3/projects/29f10e1473e94e0dbd4f8cc684803a45/users/af32d16403a242edb7b3689df308e8e2/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:21.606134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d3e0e-3f05-48f4-a4e7-3abbb188269f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f10e1473e94e0dbd4f8cc684803a45, user_id=af32d16403a242edb7b3689df308e8e2, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:21.608815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d3e0e-3f05-48f4-a4e7-3abbb188269f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:21.619796 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1251/2526] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:21 2022] PUT /identity/v3/projects/29f10e1473e94e0dbd4f8cc684803a45/users/af32d16403a242edb7b3689df308e8e2/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:21.630071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15ce9e-7ab4-46a7-b1fb-d1afae53fafc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:21.630393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15ce9e-7ab4-46a7-b1fb-d1afae53fafc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:21.630675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15ce9e-7ab4-46a7-b1fb-d1afae53fafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:21.663095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3e15ce9e-7ab4-46a7-b1fb-d1afae53fafc None None] MFA Rules not processed for user `af32d16403a242edb7b3689df308e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:21.664424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3e15ce9e-7ab4-46a7-b1fb-d1afae53fafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:21.739507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1276/2527] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:21.751474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d3e0e-3f05-48f4-a4e7-3abbb188269f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:21.753223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-754d3e0e-3f05-48f4-a4e7-3abbb188269f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:21.819958 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d3e0e-3f05-48f4-a4e7-3abbb188269f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:21.824931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dc1a3-d4a1-4b3f-9a42-ac4aec7fc12e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:21.825570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dc1a3-d4a1-4b3f-9a42-ac4aec7fc12e service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:21.825851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dc1a3-d4a1-4b3f-9a42-ac4aec7fc12e service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:21.826121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dc1a3-d4a1-4b3f-9a42-ac4aec7fc12e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:21.882478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dc1a3-d4a1-4b3f-9a42-ac4aec7fc12e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:21.883910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dc1a3-d4a1-4b3f-9a42-ac4aec7fc12e service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:21.892770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1252/2528] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:24.502710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15ce9e-7ab4-46a7-b1fb-d1afae53fafc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:24.507830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:24.514389 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15ce9e-7ab4-46a7-b1fb-d1afae53fafc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:24.518279 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52783362-ffa5-4853-9d70-667882c44324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:24.518882 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52783362-ffa5-4853-9d70-667882c44324 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:24.519165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52783362-ffa5-4853-9d70-667882c44324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:24.519440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52783362-ffa5-4853-9d70-667882c44324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:24.529722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52783362-ffa5-4853-9d70-667882c44324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:24.531134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52783362-ffa5-4853-9d70-667882c44324 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:24.541461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1277/2529] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:31.888679 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:34.537456 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:37.113291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dc1a3-d4a1-4b3f-9a42-ac4aec7fc12e service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:37.176802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dc1a3-d4a1-4b3f-9a42-ac4aec7fc12e service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:37.182340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:37.182963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:37.183245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:37.183521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] PATH_INFO: `/v3/users/57c11c4a36804cbca6515f168a297d52` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:37.184633 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c11c4a36804cbca6515f168a297d52)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:37.186576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:37.231365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c11c4a36804cbca6515f168a297d52'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.238716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c11c4a36804cbca6515f168a297d52'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.239337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c11c4a36804cbca6515f168a297d52'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.246972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c11c4a36804cbca6515f168a297d52'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.259705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c11c4a36804cbca6515f168a297d52'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.265455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1253/2530] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:37 2022] DELETE /identity/v3/users/57c11c4a36804cbca6515f168a297d52 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:37.270104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc0ce0-d9dc-437b-accc-c4d9a8c4eb84 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:37.270575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc0ce0-d9dc-437b-accc-c4d9a8c4eb84 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:37.270689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc0ce0-d9dc-437b-accc-c4d9a8c4eb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:37.290036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7ebc0ce0-d9dc-437b-accc-c4d9a8c4eb84 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:37.291224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7ebc0ce0-d9dc-437b-accc-c4d9a8c4eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:37.348052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1278/2531] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:37.358461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:37.359948 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:37.418867 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c51ae-c384-4f25-ad7a-312a3454f5c2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:37.422811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413ce99-4c89-47a6-9529-d4d6728f881b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:37.423419 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413ce99-4c89-47a6-9529-d4d6728f881b service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:37.423698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413ce99-4c89-47a6-9529-d4d6728f881b service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:37.423969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413ce99-4c89-47a6-9529-d4d6728f881b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:37.433621 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413ce99-4c89-47a6-9529-d4d6728f881b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:37.435030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413ce99-4c89-47a6-9529-d4d6728f881b service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:37.444388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1254/2532] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:37.710014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc0ce0-d9dc-437b-accc-c4d9a8c4eb84 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:37.711531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7ebc0ce0-d9dc-437b-accc-c4d9a8c4eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:37.724124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc0ce0-d9dc-437b-accc-c4d9a8c4eb84 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:37.729179 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:37.729820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:37.730101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:37.730377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] PATH_INFO: `/v3/projects/f5720ee3d8c749dea5be739d8d733fbe` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:37.731502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5720ee3d8c749dea5be739d8d733fbe)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:37.733443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:37.783382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5720ee3d8c749dea5be739d8d733fbe', 'request_id': 'req-85624bcd-8b89-4622-b6f0-b9eed813aeeb'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.789420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5720ee3d8c749dea5be739d8d733fbe', 'request_id': 'req-85624bcd-8b89-4622-b6f0-b9eed813aeeb'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.795048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5720ee3d8c749dea5be739d8d733fbe', 'request_id': 'req-85624bcd-8b89-4622-b6f0-b9eed813aeeb'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.814717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] The token cache is being invalidate because project f5720ee3d8c749dea5be739d8d733fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:37.815009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.815624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.817126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1279/2533] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:37 2022] DELETE /identity/v3/projects/f5720ee3d8c749dea5be739d8d733fbe => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:37.821844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413ce99-4c89-47a6-9529-d4d6728f881b service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:37.831672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413ce99-4c89-47a6-9529-d4d6728f881b service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:37.849308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:37.889009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:37.889932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:37.890214 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:37.890502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] PATH_INFO: `/v3/users/af32d16403a242edb7b3689df308e8e2` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:37.891614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af32d16403a242edb7b3689df308e8e2)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:37.893748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:37.947664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af32d16403a242edb7b3689df308e8e2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.957938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af32d16403a242edb7b3689df308e8e2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.958550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af32d16403a242edb7b3689df308e8e2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.965772 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af32d16403a242edb7b3689df308e8e2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.979722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-2f96ff9a-cddc-4bed-a833-ab45a02334d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af32d16403a242edb7b3689df308e8e2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:37.991700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1255/2534] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:37 2022] DELETE /identity/v3/users/af32d16403a242edb7b3689df308e8e2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:38.270133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:38.271735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:38.286733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624bcd-8b89-4622-b6f0-b9eed813aeeb admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:38.361463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:38.362482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:38.362768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:38.364298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] PATH_INFO: `/v3/projects/29f10e1473e94e0dbd4f8cc684803a45` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:38.364298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f10e1473e94e0dbd4f8cc684803a45)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:38.366988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:38.400572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:38.420446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f10e1473e94e0dbd4f8cc684803a45', 'request_id': 'req-2b167695-1c3b-4103-b5e7-8b93407d2c1a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:38.428809 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f10e1473e94e0dbd4f8cc684803a45', 'request_id': 'req-2b167695-1c3b-4103-b5e7-8b93407d2c1a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:38.439337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f10e1473e94e0dbd4f8cc684803a45', 'request_id': 'req-2b167695-1c3b-4103-b5e7-8b93407d2c1a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:38.453420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] The token cache is being invalidate because project 29f10e1473e94e0dbd4f8cc684803a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:38.453793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:38.454511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-2b167695-1c3b-4103-b5e7-8b93407d2c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:38.456014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1280/2535] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:38 2022] DELETE /identity/v3/projects/29f10e1473e94e0dbd4f8cc684803a45 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:38.461585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11946-479a-43e1-9ba4-050ea2d0151c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:38.462048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11946-479a-43e1-9ba4-050ea2d0151c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:38.462131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11946-479a-43e1-9ba4-050ea2d0151c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:38.482233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f1f11946-479a-43e1-9ba4-050ea2d0151c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:38.483420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f1f11946-479a-43e1-9ba4-050ea2d0151c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:38.546448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1256/2536] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:38.555867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4eeb-5296-4982-8455-c65b2f50e0a3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:38.556622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4eeb-5296-4982-8455-c65b2f50e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:38.556622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4eeb-5296-4982-8455-c65b2f50e0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:38.576537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-50ba4eeb-5296-4982-8455-c65b2f50e0a3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:38.577777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-50ba4eeb-5296-4982-8455-c65b2f50e0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:38.586530 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1281/2537] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:38.590591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f11946-479a-43e1-9ba4-050ea2d0151c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:38.600237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f11946-479a-43e1-9ba4-050ea2d0151c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:38.605720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c53413-2907-4ca2-b1d3-94e9c9696ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:38.606357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c53413-2907-4ca2-b1d3-94e9c9696ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:38.606605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c53413-2907-4ca2-b1d3-94e9c9696ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:38.606878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c53413-2907-4ca2-b1d3-94e9c9696ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:38.607526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c53413-2907-4ca2-b1d3-94e9c9696ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:42:38.607877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c53413-2907-4ca2-b1d3-94e9c9696ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:38.609580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c53413-2907-4ca2-b1d3-94e9c9696ba9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:38.621804 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1257/2538] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:42:38.626153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4eeb-5296-4982-8455-c65b2f50e0a3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:38.635831 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4eeb-5296-4982-8455-c65b2f50e0a3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:38.640441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6758e-b7e8-49e1-a926-88e36508e5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:38.641054 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6758e-b7e8-49e1-a926-88e36508e5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:38.641333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6758e-b7e8-49e1-a926-88e36508e5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:38.641604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6758e-b7e8-49e1-a926-88e36508e5d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:38.642222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6758e-b7e8-49e1-a926-88e36508e5d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:38.644087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6758e-b7e8-49e1-a926-88e36508e5d4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:38.673008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1282/2539] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:38 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:38.677293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c53413-2907-4ca2-b1d3-94e9c9696ba9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:38.687906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c53413-2907-4ca2-b1d3-94e9c9696ba9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:38.714688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:38.747479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16affe-f033-45d7-acaf-4e50b92064d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:38.748085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16affe-f033-45d7-acaf-4e50b92064d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:38.748367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16affe-f033-45d7-acaf-4e50b92064d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:38.748641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16affe-f033-45d7-acaf-4e50b92064d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:38.749315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16affe-f033-45d7-acaf-4e50b92064d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:38.751241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16affe-f033-45d7-acaf-4e50b92064d0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:38.771200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1258/2540] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:38 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:38.775466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6758e-b7e8-49e1-a926-88e36508e5d4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:38.785651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6758e-b7e8-49e1-a926-88e36508e5d4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:38.790694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b025f-4958-4520-95b8-f2765356f0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:38.791307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b025f-4958-4520-95b8-f2765356f0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:38.791582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b025f-4958-4520-95b8-f2765356f0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:38.791851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b025f-4958-4520-95b8-f2765356f0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:38.792478 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b025f-4958-4520-95b8-f2765356f0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:38.794083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b025f-4958-4520-95b8-f2765356f0d3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:38.803717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1283/2541] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:38.807499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16affe-f033-45d7-acaf-4e50b92064d0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:38.817313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16affe-f033-45d7-acaf-4e50b92064d0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:38.822424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ec53d-674e-489b-ba1e-5cf95c941b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:38.823001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ec53d-674e-489b-ba1e-5cf95c941b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:38.823281 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ec53d-674e-489b-ba1e-5cf95c941b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:38.823552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ec53d-674e-489b-ba1e-5cf95c941b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:38.824182 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ec53d-674e-489b-ba1e-5cf95c941b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:38.825800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ec53d-674e-489b-ba1e-5cf95c941b20 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:38.837704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1259/2542] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:38.841597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b025f-4958-4520-95b8-f2765356f0d3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:38.851227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b025f-4958-4520-95b8-f2765356f0d3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:38.856056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79d548-eac9-47bd-8a3a-7a334aa84f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:38.856682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79d548-eac9-47bd-8a3a-7a334aa84f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:38.856986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79d548-eac9-47bd-8a3a-7a334aa84f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:38.857261 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79d548-eac9-47bd-8a3a-7a334aa84f75 admin admin] PATH_INFO: `/v3/projects/ea93eb694b2745a3af625d7b06f9f62e/users/47e5b5c163244c918ad6af9d5258d157/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:38.871712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79d548-eac9-47bd-8a3a-7a334aa84f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea93eb694b2745a3af625d7b06f9f62e, user_id=47e5b5c163244c918ad6af9d5258d157, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:38.874338 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79d548-eac9-47bd-8a3a-7a334aa84f75 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:38.888301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1284/2543] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:38 2022] PUT /identity/v3/projects/ea93eb694b2745a3af625d7b06f9f62e/users/47e5b5c163244c918ad6af9d5258d157/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:42:38.898864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2f06-c48f-49bb-b20f-d75ca921125e None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:38.899146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2f06-c48f-49bb-b20f-d75ca921125e None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:38.899410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2f06-c48f-49bb-b20f-d75ca921125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:38.925738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0eec2f06-c48f-49bb-b20f-d75ca921125e None None] MFA Rules not processed for user `47e5b5c163244c918ad6af9d5258d157`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:38.926865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0eec2f06-c48f-49bb-b20f-d75ca921125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:38.988860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1260/2544] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:38.993519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79d548-eac9-47bd-8a3a-7a334aa84f75 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:39.053091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79d548-eac9-47bd-8a3a-7a334aa84f75 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:39.058141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e716a7-56fd-4117-98a8-da525c6a70f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:39.058728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e716a7-56fd-4117-98a8-da525c6a70f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:39.059005 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e716a7-56fd-4117-98a8-da525c6a70f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:39.059273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e716a7-56fd-4117-98a8-da525c6a70f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:39.059898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e716a7-56fd-4117-98a8-da525c6a70f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:39.061812 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e716a7-56fd-4117-98a8-da525c6a70f5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:39.088660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1285/2545] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:38 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:39.092755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2f06-c48f-49bb-b20f-d75ca921125e None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:39.104527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2f06-c48f-49bb-b20f-d75ca921125e None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:39.159597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d23c23-35d1-4988-a1cc-d7e15fdc7639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:39.160201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d23c23-35d1-4988-a1cc-d7e15fdc7639 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:39.160486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d23c23-35d1-4988-a1cc-d7e15fdc7639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:39.160764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d23c23-35d1-4988-a1cc-d7e15fdc7639 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:39.161437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d23c23-35d1-4988-a1cc-d7e15fdc7639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:39.163489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d23c23-35d1-4988-a1cc-d7e15fdc7639 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:39.184098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1261/2546] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:39 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:39.188105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e716a7-56fd-4117-98a8-da525c6a70f5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:39.198323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e716a7-56fd-4117-98a8-da525c6a70f5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:39.202859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e0bdb-98ae-4865-aa1d-de86364565fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:39.203443 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e0bdb-98ae-4865-aa1d-de86364565fd admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:39.203720 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e0bdb-98ae-4865-aa1d-de86364565fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:39.203988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e0bdb-98ae-4865-aa1d-de86364565fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:39.204618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e0bdb-98ae-4865-aa1d-de86364565fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:39.206228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e0bdb-98ae-4865-aa1d-de86364565fd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:39.217033 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1286/2547] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:39.221037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d23c23-35d1-4988-a1cc-d7e15fdc7639 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:39.231743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d23c23-35d1-4988-a1cc-d7e15fdc7639 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:39.236336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89f62d-f2af-4302-addb-0f138443e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:39.236994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f62d-f2af-4302-addb-0f138443e2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:39.237301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f62d-f2af-4302-addb-0f138443e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:39.237579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f62d-f2af-4302-addb-0f138443e2d9 admin admin] PATH_INFO: `/v3/projects/1d9bedd8cd594962a3ddb272d2b91fa0/users/7b194aeabf67409d940ac7f8649be3b4/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:39.252430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89f62d-f2af-4302-addb-0f138443e2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9bedd8cd594962a3ddb272d2b91fa0, user_id=7b194aeabf67409d940ac7f8649be3b4, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:39.256198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89f62d-f2af-4302-addb-0f138443e2d9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:39.269219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1262/2548] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:39 2022] PUT /identity/v3/projects/1d9bedd8cd594962a3ddb272d2b91fa0/users/7b194aeabf67409d940ac7f8649be3b4/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:39.273784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e0bdb-98ae-4865-aa1d-de86364565fd admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:39.284234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e0bdb-98ae-4865-aa1d-de86364565fd admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:39.304876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:39.343336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e42c3c-14d2-4d16-8b12-7fdb9a23b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:39.343937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42c3c-14d2-4d16-8b12-7fdb9a23b97a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:39.344214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42c3c-14d2-4d16-8b12-7fdb9a23b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:39.344483 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42c3c-14d2-4d16-8b12-7fdb9a23b97a admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:39.345143 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e42c3c-14d2-4d16-8b12-7fdb9a23b97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:39.346710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e42c3c-14d2-4d16-8b12-7fdb9a23b97a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:39.357754 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1287/2549] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:42:39.362044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89f62d-f2af-4302-addb-0f138443e2d9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:39.367493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:39.374678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89f62d-f2af-4302-addb-0f138443e2d9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:39.379586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fb1a2-98de-4382-bcf7-f895d7a13912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:39.380596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb1a2-98de-4382-bcf7-f895d7a13912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:39.380731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb1a2-98de-4382-bcf7-f895d7a13912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:39.381118 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb1a2-98de-4382-bcf7-f895d7a13912 admin admin] PATH_INFO: `/v3/projects/1d9bedd8cd594962a3ddb272d2b91fa0/users/7b194aeabf67409d940ac7f8649be3b4/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:39.383836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fb1a2-98de-4382-bcf7-f895d7a13912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9bedd8cd594962a3ddb272d2b91fa0, user_id=7b194aeabf67409d940ac7f8649be3b4, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:39.386782 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fb1a2-98de-4382-bcf7-f895d7a13912 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:39.397156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1263/2550] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:39 2022] PUT /identity/v3/projects/1d9bedd8cd594962a3ddb272d2b91fa0/users/7b194aeabf67409d940ac7f8649be3b4/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:42:39.407923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70470e-dbe2-4f7b-938a-72397e6ee9c5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:39.408212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70470e-dbe2-4f7b-938a-72397e6ee9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:39.408491 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70470e-dbe2-4f7b-938a-72397e6ee9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:39.435416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ea70470e-dbe2-4f7b-938a-72397e6ee9c5 None None] MFA Rules not processed for user `7b194aeabf67409d940ac7f8649be3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:39.436534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ea70470e-dbe2-4f7b-938a-72397e6ee9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:39.503322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1288/2551] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:39.514366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fb1a2-98de-4382-bcf7-f895d7a13912 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:39.516124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-da9fb1a2-98de-4382-bcf7-f895d7a13912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:39.573223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fb1a2-98de-4382-bcf7-f895d7a13912 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:39.576964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486524b6-7af2-4e43-a8fe-61e7b02f81de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:39.577571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486524b6-7af2-4e43-a8fe-61e7b02f81de service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:39.577850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486524b6-7af2-4e43-a8fe-61e7b02f81de service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:39.578228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486524b6-7af2-4e43-a8fe-61e7b02f81de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:39.587615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486524b6-7af2-4e43-a8fe-61e7b02f81de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:39.589072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486524b6-7af2-4e43-a8fe-61e7b02f81de service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:39.598400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1264/2552] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:40.156826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70470e-dbe2-4f7b-938a-72397e6ee9c5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:40.218304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70470e-dbe2-4f7b-938a-72397e6ee9c5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:40.222857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:40.223414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:40.223691 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:40.223966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] PATH_INFO: `/v3/users/47e5b5c163244c918ad6af9d5258d157` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:40.225108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e5b5c163244c918ad6af9d5258d157)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:40.227099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:40.272181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e5b5c163244c918ad6af9d5258d157'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:40.273390 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e5b5c163244c918ad6af9d5258d157'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:40.274614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:40.282354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e5b5c163244c918ad6af9d5258d157'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:40.294515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e5b5c163244c918ad6af9d5258d157'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:40.295212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e5b5c163244c918ad6af9d5258d157'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:40.309836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1289/2553] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:40 2022] DELETE /identity/v3/users/47e5b5c163244c918ad6af9d5258d157 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:40.314322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733d732-befe-4c2e-a756-f9bc5de8f44d None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:40.314613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733d732-befe-4c2e-a756-f9bc5de8f44d None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:40.314893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733d732-befe-4c2e-a756-f9bc5de8f44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:40.334103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-8733d732-befe-4c2e-a756-f9bc5de8f44d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:40.335985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8733d732-befe-4c2e-a756-f9bc5de8f44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:40.401012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1265/2554] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:40.410636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:40.412103 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:40.472016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a284f0-99df-47f2-997b-07ea40dd7812 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:40.476246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f189e-8dc6-446a-87e2-5c2232694432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:40.476793 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f189e-8dc6-446a-87e2-5c2232694432 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:40.477114 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f189e-8dc6-446a-87e2-5c2232694432 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:40.477674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f189e-8dc6-446a-87e2-5c2232694432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:40.486734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f189e-8dc6-446a-87e2-5c2232694432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:40.488146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f189e-8dc6-446a-87e2-5c2232694432 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:40.498555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1290/2555] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:40.764763 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733d732-befe-4c2e-a756-f9bc5de8f44d None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:40.767069 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8733d732-befe-4c2e-a756-f9bc5de8f44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:40.782562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733d732-befe-4c2e-a756-f9bc5de8f44d None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:40.788543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:40.789212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:40.789491 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:40.789762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] PATH_INFO: `/v3/projects/ea93eb694b2745a3af625d7b06f9f62e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:40.791288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea93eb694b2745a3af625d7b06f9f62e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:40.792825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:40.851151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea93eb694b2745a3af625d7b06f9f62e', 'request_id': 'req-a5e76d6d-0425-4460-97c3-89cd0794c6c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:40.858573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea93eb694b2745a3af625d7b06f9f62e', 'request_id': 'req-a5e76d6d-0425-4460-97c3-89cd0794c6c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:40.865125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea93eb694b2745a3af625d7b06f9f62e', 'request_id': 'req-a5e76d6d-0425-4460-97c3-89cd0794c6c6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:40.879697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] The token cache is being invalidate because project ea93eb694b2745a3af625d7b06f9f62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:40.879992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:40.880596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:40.882940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1266/2556] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:40 2022] DELETE /identity/v3/projects/ea93eb694b2745a3af625d7b06f9f62e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:40.886788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f189e-8dc6-446a-87e2-5c2232694432 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:40.896752 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f189e-8dc6-446a-87e2-5c2232694432 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:40.958158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:40.958949 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:40.959231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:40.959502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] PATH_INFO: `/v3/users/7b194aeabf67409d940ac7f8649be3b4` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:40.960676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b194aeabf67409d940ac7f8649be3b4)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:40.962616 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:41.016828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b194aeabf67409d940ac7f8649be3b4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:41.017527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b194aeabf67409d940ac7f8649be3b4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:41.025102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b194aeabf67409d940ac7f8649be3b4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:41.035217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:41.038062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b194aeabf67409d940ac7f8649be3b4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:41.039062 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b194aeabf67409d940ac7f8649be3b4'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:41.054673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1291/2557] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:40 2022] DELETE /identity/v3/users/7b194aeabf67409d940ac7f8649be3b4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:41.347685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:41.349278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:41.384935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e76d6d-0425-4460-97c3-89cd0794c6c6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:41.409460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:41.466903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:41.468422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:41.468668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:41.468939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] PATH_INFO: `/v3/projects/1d9bedd8cd594962a3ddb272d2b91fa0` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:41.470196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9bedd8cd594962a3ddb272d2b91fa0)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:41.472682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:41.497307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:41.498742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:41.559997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9bedd8cd594962a3ddb272d2b91fa0', 'request_id': 'req-a8e40745-facc-4948-a6d2-c7cbf5224c08'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:41.568526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9bedd8cd594962a3ddb272d2b91fa0', 'request_id': 'req-a8e40745-facc-4948-a6d2-c7cbf5224c08'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:41.590537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9bedd8cd594962a3ddb272d2b91fa0', 'request_id': 'req-a8e40745-facc-4948-a6d2-c7cbf5224c08'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:41.611085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6219ee-2f65-4abe-a5e2-9271d34a8220 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:41.619438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] The token cache is being invalidate because project 1d9bedd8cd594962a3ddb272d2b91fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:41.619722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:41.620479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a8e40745-facc-4948-a6d2-c7cbf5224c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:41.622247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1267/2558] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:41 2022] DELETE /identity/v3/projects/1d9bedd8cd594962a3ddb272d2b91fa0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:41.626937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b5a3-5494-4f42-a91b-fbb0b557f583 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:41.630611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b5a3-5494-4f42-a91b-fbb0b557f583 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:41.630985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b5a3-5494-4f42-a91b-fbb0b557f583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:41.657903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a7a1b5a3-5494-4f42-a91b-fbb0b557f583 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:41.661641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a7a1b5a3-5494-4f42-a91b-fbb0b557f583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:41.692309 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9074-0b53-47df-9c28-ffdd6a32e5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:41.693031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9074-0b53-47df-9c28-ffdd6a32e5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:41.693402 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9074-0b53-47df-9c28-ffdd6a32e5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:41.693814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9074-0b53-47df-9c28-ffdd6a32e5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:41.701955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-41af9074-0b53-47df-9c28-ffdd6a32e5a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:41.739909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1268/2559] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:41.749459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179ac0f-1e3e-4b31-8448-a58e7f114214 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:41.757350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179ac0f-1e3e-4b31-8448-a58e7f114214 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:41.757657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179ac0f-1e3e-4b31-8448-a58e7f114214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:41.782649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-7179ac0f-1e3e-4b31-8448-a58e7f114214 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:41.783856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7179ac0f-1e3e-4b31-8448-a58e7f114214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:41.788437 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af9074-0b53-47df-9c28-ffdd6a32e5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:41.790232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af9074-0b53-47df-9c28-ffdd6a32e5a3 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:41.793105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1269/2560] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:41.797524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179ac0f-1e3e-4b31-8448-a58e7f114214 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:41.801588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1292/2561] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:42:41.810540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179ac0f-1e3e-4b31-8448-a58e7f114214 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:41.816313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cebf6-ac7b-48e7-98ec-84db5273f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:41.817024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cebf6-ac7b-48e7-98ec-84db5273f099 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:41.817596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cebf6-ac7b-48e7-98ec-84db5273f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:41.817865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cebf6-ac7b-48e7-98ec-84db5273f099 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:41.818416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cebf6-ac7b-48e7-98ec-84db5273f099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:42:41.818720 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cebf6-ac7b-48e7-98ec-84db5273f099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:41.820857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cebf6-ac7b-48e7-98ec-84db5273f099 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:41.838992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1270/2562] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:42:41.843865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9074-0b53-47df-9c28-ffdd6a32e5a3 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:41.857565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9074-0b53-47df-9c28-ffdd6a32e5a3 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:41.862710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5992f-e4f7-4ce2-a7ff-95849024cce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:41.863470 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5992f-e4f7-4ce2-a7ff-95849024cce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:41.863827 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5992f-e4f7-4ce2-a7ff-95849024cce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:41.864217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5992f-e4f7-4ce2-a7ff-95849024cce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:41.865161 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5992f-e4f7-4ce2-a7ff-95849024cce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:41.867803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5992f-e4f7-4ce2-a7ff-95849024cce4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:41.905543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1293/2563] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:41 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:42:41.909567 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cebf6-ac7b-48e7-98ec-84db5273f099 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:41.920730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cebf6-ac7b-48e7-98ec-84db5273f099 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:41.948411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:41.993363 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93821c07-74de-4e33-ad6f-5e2cf5739839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:41.993976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93821c07-74de-4e33-ad6f-5e2cf5739839 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:41.994254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93821c07-74de-4e33-ad6f-5e2cf5739839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:41.994526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93821c07-74de-4e33-ad6f-5e2cf5739839 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:41.995168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93821c07-74de-4e33-ad6f-5e2cf5739839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:41.997095 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93821c07-74de-4e33-ad6f-5e2cf5739839 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:42.019688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1271/2564] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:41 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:42:42.024368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5992f-e4f7-4ce2-a7ff-95849024cce4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:42.036231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5992f-e4f7-4ce2-a7ff-95849024cce4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:42.042998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fb97c-7dbd-450d-ab5f-612c6d19b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:42.043768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb97c-7dbd-450d-ab5f-612c6d19b435 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:42.044061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb97c-7dbd-450d-ab5f-612c6d19b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:42.044753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fb97c-7dbd-450d-ab5f-612c6d19b435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:42.045006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fb97c-7dbd-450d-ab5f-612c6d19b435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:42.046916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fb97c-7dbd-450d-ab5f-612c6d19b435 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:42.060032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1294/2565] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:42.064047 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93821c07-74de-4e33-ad6f-5e2cf5739839 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:42.075653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93821c07-74de-4e33-ad6f-5e2cf5739839 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:42.080554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0717f-be75-4f5d-902f-7f3151afb521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:42.081192 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0717f-be75-4f5d-902f-7f3151afb521 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:42.081478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0717f-be75-4f5d-902f-7f3151afb521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:42.081752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0717f-be75-4f5d-902f-7f3151afb521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:42.082392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0717f-be75-4f5d-902f-7f3151afb521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:42.084012 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0717f-be75-4f5d-902f-7f3151afb521 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:42.100159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1272/2566] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:42.101717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fb97c-7dbd-450d-ab5f-612c6d19b435 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:42.113671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fb97c-7dbd-450d-ab5f-612c6d19b435 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:42.119863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab951a-9e0a-4a0f-9fab-5933f91e8ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:42.120710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab951a-9e0a-4a0f-9fab-5933f91e8ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:42.121140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab951a-9e0a-4a0f-9fab-5933f91e8ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:42.121638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab951a-9e0a-4a0f-9fab-5933f91e8ca1 admin admin] PATH_INFO: `/v3/projects/2b7fcc584bda4eaa8f26f6bf32a589aa/users/d3a16e68b4a74de3ac26186d1d09cee2/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:42.142841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab951a-9e0a-4a0f-9fab-5933f91e8ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7fcc584bda4eaa8f26f6bf32a589aa, user_id=d3a16e68b4a74de3ac26186d1d09cee2, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:42.146232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab951a-9e0a-4a0f-9fab-5933f91e8ca1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:42.157731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:42.167176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1295/2567] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:42 2022] PUT /identity/v3/projects/2b7fcc584bda4eaa8f26f6bf32a589aa/users/d3a16e68b4a74de3ac26186d1d09cee2/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:42:42.176791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63c7e2-3546-4b44-84d0-28a2472aa5ec None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:42.177224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63c7e2-3546-4b44-84d0-28a2472aa5ec None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:42.177604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63c7e2-3546-4b44-84d0-28a2472aa5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:42.226889 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-de63c7e2-3546-4b44-84d0-28a2472aa5ec None None] MFA Rules not processed for user `d3a16e68b4a74de3ac26186d1d09cee2`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:42.228668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-de63c7e2-3546-4b44-84d0-28a2472aa5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:42.347564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1273/2568] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:42.364913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab951a-9e0a-4a0f-9fab-5933f91e8ca1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:42.367801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-31ab951a-9e0a-4a0f-9fab-5933f91e8ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:42.445714 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab951a-9e0a-4a0f-9fab-5933f91e8ca1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:42.449411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa6cce-dd85-4044-94b8-7a02d7e288ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfef506919f4914a7883bd99ea07615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:42.450100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6cce-dd85-4044-94b8-7a02d7e288ee service glance] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:42.450452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6cce-dd85-4044-94b8-7a02d7e288ee service glance] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:42.450787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6cce-dd85-4044-94b8-7a02d7e288ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:42.461570 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa6cce-dd85-4044-94b8-7a02d7e288ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:42.463488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa6cce-dd85-4044-94b8-7a02d7e288ee service glance] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:42.478075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1296/2569] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:46.472295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63c7e2-3546-4b44-84d0-28a2472aa5ec None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:46.473820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-de63c7e2-3546-4b44-84d0-28a2472aa5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:46.529322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63c7e2-3546-4b44-84d0-28a2472aa5ec None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:46.532838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10c758-b033-47bb-9791-0665ba563350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:46.533482 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10c758-b033-47bb-9791-0665ba563350 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:46.533761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10c758-b033-47bb-9791-0665ba563350 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:46.534029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10c758-b033-47bb-9791-0665ba563350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:46.535799 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0d10c758-b033-47bb-9791-0665ba563350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:46.583286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:46.599692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10c758-b033-47bb-9791-0665ba563350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:46.601248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10c758-b033-47bb-9791-0665ba563350 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:46.611343 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1274/2570] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:48.414790 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa6cce-dd85-4044-94b8-7a02d7e288ee service glance] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:48.425750 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa6cce-dd85-4044-94b8-7a02d7e288ee service glance] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:48.429854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd1a19-e65c-4cbd-9daf-62ac028cc22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:48.430452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd1a19-e65c-4cbd-9daf-62ac028cc22b service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:48.437859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd1a19-e65c-4cbd-9daf-62ac028cc22b service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:48.438246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd1a19-e65c-4cbd-9daf-62ac028cc22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:48.442202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-20fd1a19-e65c-4cbd-9daf-62ac028cc22b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:48.455878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd1a19-e65c-4cbd-9daf-62ac028cc22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:48.457654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd1a19-e65c-4cbd-9daf-62ac028cc22b service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:48.468323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1297/2571] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:50.079592 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10c758-b033-47bb-9791-0665ba563350 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:50.081237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0d10c758-b033-47bb-9791-0665ba563350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:50.156179 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd1a19-e65c-4cbd-9daf-62ac028cc22b service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:50.158377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-20fd1a19-e65c-4cbd-9daf-62ac028cc22b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:50.183977 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd1a19-e65c-4cbd-9daf-62ac028cc22b service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:50.205737 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:50.206399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:50.206679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:50.206956 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] PATH_INFO: `/v3/users/e0589d6270464a4c8f5ed7680ca48164` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:50.214028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10c758-b033-47bb-9791-0665ba563350 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:50.220548 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c5fff-a282-44c0-96ee-f4dc13709e66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:50.221290 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5fff-a282-44c0-96ee-f4dc13709e66 service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:50.221667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5fff-a282-44c0-96ee-f4dc13709e66 service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:50.222034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5fff-a282-44c0-96ee-f4dc13709e66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:50.223950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-473c5fff-a282-44c0-96ee-f4dc13709e66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:50.230945 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0589d6270464a4c8f5ed7680ca48164)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:50.232894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:50.242496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c5fff-a282-44c0-96ee-f4dc13709e66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:50.244646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c5fff-a282-44c0-96ee-f4dc13709e66 service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:50.271973 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1275/2572] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:50.322699 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0589d6270464a4c8f5ed7680ca48164'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:50.323451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0589d6270464a4c8f5ed7680ca48164'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:50.331645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0589d6270464a4c8f5ed7680ca48164'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:50.352649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0589d6270464a4c8f5ed7680ca48164'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:50.367408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c833f9f7-5698-4328-b64b-b36cd3d92bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0589d6270464a4c8f5ed7680ca48164'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:50.395372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1298/2573] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:50 2022] DELETE /identity/v3/users/e0589d6270464a4c8f5ed7680ca48164 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:51.054430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c5fff-a282-44c0-96ee-f4dc13709e66 service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:51.065998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c5fff-a282-44c0-96ee-f4dc13709e66 service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:51.150469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:51.151431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:51.151719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:51.151987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] PATH_INFO: `/v3/projects/aed6e3e3c5994aac8ff1bfbb7f754000` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:51.164806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed6e3e3c5994aac8ff1bfbb7f754000)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:51.167195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:51.227183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed6e3e3c5994aac8ff1bfbb7f754000', 'request_id': 'req-b59229d9-570a-4ab3-aaec-ba623e3d2855'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:51.240230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed6e3e3c5994aac8ff1bfbb7f754000', 'request_id': 'req-b59229d9-570a-4ab3-aaec-ba623e3d2855'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:51.250988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed6e3e3c5994aac8ff1bfbb7f754000', 'request_id': 'req-b59229d9-570a-4ab3-aaec-ba623e3d2855'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:51.255806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:51.274967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] The token cache is being invalidate because project aed6e3e3c5994aac8ff1bfbb7f754000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:51.275496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:51.276405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b59229d9-570a-4ab3-aaec-ba623e3d2855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:51.278748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1276/2574] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:51 2022] DELETE /identity/v3/projects/aed6e3e3c5994aac8ff1bfbb7f754000 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:51.284787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5bc0a-d669-4228-9a6d-9c3842b12f0d None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:51.285311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5bc0a-d669-4228-9a6d-9c3842b12f0d None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:51.285403 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5bc0a-d669-4228-9a6d-9c3842b12f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:51.325325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-92f5bc0a-d669-4228-9a6d-9c3842b12f0d None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:51.326693 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-92f5bc0a-d669-4228-9a6d-9c3842b12f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:51.380484 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:51.405357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1299/2575] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:51.409660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6920c7-bac4-410f-8744-7b427b72806c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:51.410199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6920c7-bac4-410f-8744-7b427b72806c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:51.410473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6920c7-bac4-410f-8744-7b427b72806c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:51.434295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-be6920c7-bac4-410f-8744-7b427b72806c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:51.436483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-be6920c7-bac4-410f-8744-7b427b72806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:51.454640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5bc0a-d669-4228-9a6d-9c3842b12f0d None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:51.465146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1277/2576] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:51.472300 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5bc0a-d669-4228-9a6d-9c3842b12f0d None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:51.479720 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33384afe-6b84-4064-ada5-c5e40b1b04b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:51.480358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384afe-6b84-4064-ada5-c5e40b1b04b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:51.480641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384afe-6b84-4064-ada5-c5e40b1b04b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:51.481644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384afe-6b84-4064-ada5-c5e40b1b04b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:51.481644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33384afe-6b84-4064-ada5-c5e40b1b04b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:42:51.481921 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33384afe-6b84-4064-ada5-c5e40b1b04b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:51.484361 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33384afe-6b84-4064-ada5-c5e40b1b04b1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:51.513010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1300/2577] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:42:51.513756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6920c7-bac4-410f-8744-7b427b72806c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:51.524475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6920c7-bac4-410f-8744-7b427b72806c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:51.529832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08e5fe-0a7a-43c2-a2d1-c2ae04fdad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:51.530532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e5fe-0a7a-43c2-a2d1-c2ae04fdad67 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:51.530888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e5fe-0a7a-43c2-a2d1-c2ae04fdad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:51.531236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e5fe-0a7a-43c2-a2d1-c2ae04fdad67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:51.531957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08e5fe-0a7a-43c2-a2d1-c2ae04fdad67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:51.534739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08e5fe-0a7a-43c2-a2d1-c2ae04fdad67 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:51.597714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1278/2578] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:51 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:51.598867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33384afe-6b84-4064-ada5-c5e40b1b04b1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:51.611342 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33384afe-6b84-4064-ada5-c5e40b1b04b1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:51.709099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a77a2-dae0-4331-be08-f9617274d112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:51.709732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a77a2-dae0-4331-be08-f9617274d112 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:51.710092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a77a2-dae0-4331-be08-f9617274d112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:51.710369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a77a2-dae0-4331-be08-f9617274d112 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:51.711012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a77a2-dae0-4331-be08-f9617274d112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:51.713251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a77a2-dae0-4331-be08-f9617274d112 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:51.750663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1301/2579] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:51 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:42:51.751940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08e5fe-0a7a-43c2-a2d1-c2ae04fdad67 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:51.765639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08e5fe-0a7a-43c2-a2d1-c2ae04fdad67 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:51.771901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e37f1c-8e40-4eb6-b109-fc7f319462cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:51.773567 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e37f1c-8e40-4eb6-b109-fc7f319462cb admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:51.774248 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e37f1c-8e40-4eb6-b109-fc7f319462cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:51.774710 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e37f1c-8e40-4eb6-b109-fc7f319462cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:51.775375 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e37f1c-8e40-4eb6-b109-fc7f319462cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:51.777066 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e37f1c-8e40-4eb6-b109-fc7f319462cb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:51.791560 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1279/2580] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:51.796346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a77a2-dae0-4331-be08-f9617274d112 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:51.807067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a77a2-dae0-4331-be08-f9617274d112 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:51.813306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483975df-cd2f-4526-b903-b17ea81c990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:51.814174 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483975df-cd2f-4526-b903-b17ea81c990f admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:51.814434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483975df-cd2f-4526-b903-b17ea81c990f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:51.815202 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483975df-cd2f-4526-b903-b17ea81c990f admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:51.815838 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483975df-cd2f-4526-b903-b17ea81c990f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:51.817623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483975df-cd2f-4526-b903-b17ea81c990f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:51.844824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1302/2581] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:51.846266 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e37f1c-8e40-4eb6-b109-fc7f319462cb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:51.857271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e37f1c-8e40-4eb6-b109-fc7f319462cb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:51.862861 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2a3c6-bf78-4635-b7d8-a0f19b25c612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:51.863605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2a3c6-bf78-4635-b7d8-a0f19b25c612 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:51.864005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2a3c6-bf78-4635-b7d8-a0f19b25c612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:51.864330 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2a3c6-bf78-4635-b7d8-a0f19b25c612 admin admin] PATH_INFO: `/v3/projects/de12824dd02c454580f9ae5a6071a3d5/users/7ee29f94700a408c8782e4be026439fc/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:51.885718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2a3c6-bf78-4635-b7d8-a0f19b25c612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de12824dd02c454580f9ae5a6071a3d5, user_id=7ee29f94700a408c8782e4be026439fc, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:51.888730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2a3c6-bf78-4635-b7d8-a0f19b25c612 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:51.903288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1280/2582] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:51 2022] PUT /identity/v3/projects/de12824dd02c454580f9ae5a6071a3d5/users/7ee29f94700a408c8782e4be026439fc/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:51.914418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd26c27-63fa-478d-9cb7-658b2d7d2104 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:51.914814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd26c27-63fa-478d-9cb7-658b2d7d2104 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:51.915092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd26c27-63fa-478d-9cb7-658b2d7d2104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:51.954354 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ccd26c27-63fa-478d-9cb7-658b2d7d2104 None None] MFA Rules not processed for user `7ee29f94700a408c8782e4be026439fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:51.955575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ccd26c27-63fa-478d-9cb7-658b2d7d2104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:52.050825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1303/2583] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:52.058812 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2a3c6-bf78-4635-b7d8-a0f19b25c612 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:52.060801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-63b2a3c6-bf78-4635-b7d8-a0f19b25c612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:52.154008 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2a3c6-bf78-4635-b7d8-a0f19b25c612 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:52.160417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadc343-9195-4b0d-b538-58ef72560428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:52.161056 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadc343-9195-4b0d-b538-58ef72560428 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:52.161334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadc343-9195-4b0d-b538-58ef72560428 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:52.161604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadc343-9195-4b0d-b538-58ef72560428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:52.170917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadc343-9195-4b0d-b538-58ef72560428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:52.172675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadc343-9195-4b0d-b538-58ef72560428 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:52.183366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1281/2584] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:52.205462 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd26c27-63fa-478d-9cb7-658b2d7d2104 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:52.206851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ccd26c27-63fa-478d-9cb7-658b2d7d2104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:52.265824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:52.272262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd26c27-63fa-478d-9cb7-658b2d7d2104 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:52.276825 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51e92d-f439-4d1c-98d7-4d857dd4a37a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:52.277510 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51e92d-f439-4d1c-98d7-4d857dd4a37a service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:52.277813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51e92d-f439-4d1c-98d7-4d857dd4a37a service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:52.278092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51e92d-f439-4d1c-98d7-4d857dd4a37a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:52.279811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9d51e92d-f439-4d1c-98d7-4d857dd4a37a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:52.295821 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51e92d-f439-4d1c-98d7-4d857dd4a37a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:52.297961 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51e92d-f439-4d1c-98d7-4d857dd4a37a service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:52.311655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1304/2585] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:52.668981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadc343-9195-4b0d-b538-58ef72560428 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:52.679500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadc343-9195-4b0d-b538-58ef72560428 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:52.684061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b49185-a427-4d11-9607-461d2506513f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:52.684693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b49185-a427-4d11-9607-461d2506513f service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:52.684994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b49185-a427-4d11-9607-461d2506513f service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:52.685695 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b49185-a427-4d11-9607-461d2506513f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:52.687982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-41b49185-a427-4d11-9607-461d2506513f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:52.702079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b49185-a427-4d11-9607-461d2506513f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:52.703593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b49185-a427-4d11-9607-461d2506513f service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:52.715921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1282/2586] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:55.112154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51e92d-f439-4d1c-98d7-4d857dd4a37a service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:55.113943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b49185-a427-4d11-9607-461d2506513f service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:55.114315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9d51e92d-f439-4d1c-98d7-4d857dd4a37a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:55.185222 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:55.192480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b49185-a427-4d11-9607-461d2506513f service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:55.200276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51e92d-f439-4d1c-98d7-4d857dd4a37a service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:55.200686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:55.201689 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:55.202334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:55.202911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] PATH_INFO: `/v3/users/7ee29f94700a408c8782e4be026439fc` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:55.204924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee29f94700a408c8782e4be026439fc)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:55.205228 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:55.211247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:55.211247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:55.211247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] PATH_INFO: `/v3/users/36b04859aac64e9e9157e1188c1b224c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:55.211728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:55.213315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b04859aac64e9e9157e1188c1b224c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:55.217515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:55.261112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee29f94700a408c8782e4be026439fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.269092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee29f94700a408c8782e4be026439fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.271898 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee29f94700a408c8782e4be026439fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.273719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b04859aac64e9e9157e1188c1b224c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.274602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b04859aac64e9e9157e1188c1b224c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.279288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee29f94700a408c8782e4be026439fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.282139 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b04859aac64e9e9157e1188c1b224c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.292826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-066ee592-891b-453d-805f-9cba7c191802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee29f94700a408c8782e4be026439fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.296710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b04859aac64e9e9157e1188c1b224c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.297544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b04859aac64e9e9157e1188c1b224c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.299383 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1283/2587] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:55 2022] DELETE /identity/v3/users/7ee29f94700a408c8782e4be026439fc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:55.304553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f30d-f185-445e-ae4b-9d9e49058334 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:55.304991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f30d-f185-445e-ae4b-9d9e49058334 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:55.305337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f30d-f185-445e-ae4b-9d9e49058334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:55.317498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1305/2588] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:55 2022] DELETE /identity/v3/users/36b04859aac64e9e9157e1188c1b224c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:55.325171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0028f30d-f185-445e-ae4b-9d9e49058334 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:55.326297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0028f30d-f185-445e-ae4b-9d9e49058334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:55.402590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1284/2589] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:55.403952 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:55.405532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:55.472085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231da886-4841-4c15-979a-012cae05f5fe admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:55.478100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dc123-6432-4c17-a987-4e2d5ea35ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:55.478995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dc123-6432-4c17-a987-4e2d5ea35ccf service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:55.479427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dc123-6432-4c17-a987-4e2d5ea35ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:55.479822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dc123-6432-4c17-a987-4e2d5ea35ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:55.490915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dc123-6432-4c17-a987-4e2d5ea35ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:55.492596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dc123-6432-4c17-a987-4e2d5ea35ccf service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:55.505726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1306/2590] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:55.510337 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f30d-f185-445e-ae4b-9d9e49058334 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:55.512503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0028f30d-f185-445e-ae4b-9d9e49058334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:55.529954 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f30d-f185-445e-ae4b-9d9e49058334 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:55.536570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:55.537351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:55.537639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:55.537918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] PATH_INFO: `/v3/projects/721fea451c95496eab7d3278e8b66126` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:55.539146 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=721fea451c95496eab7d3278e8b66126)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:55.541445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:55.594667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721fea451c95496eab7d3278e8b66126', 'request_id': 'req-b418ff40-8030-49e9-b184-8e70713aae30'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.603747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721fea451c95496eab7d3278e8b66126', 'request_id': 'req-b418ff40-8030-49e9-b184-8e70713aae30'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.609610 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721fea451c95496eab7d3278e8b66126', 'request_id': 'req-b418ff40-8030-49e9-b184-8e70713aae30'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.620139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:55.625051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] The token cache is being invalidate because project 721fea451c95496eab7d3278e8b66126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:55.625511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.626508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.629019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1285/2591] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:55 2022] DELETE /identity/v3/projects/721fea451c95496eab7d3278e8b66126 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:55.633542 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dc123-6432-4c17-a987-4e2d5ea35ccf service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:55.643383 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dc123-6432-4c17-a987-4e2d5ea35ccf service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:55.651511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:55.711407 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:55.712041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:55.712324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:55.713039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] PATH_INFO: `/v3/users/861dae3b1620455a9e55eebbce30a9dd` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:55.713941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=861dae3b1620455a9e55eebbce30a9dd)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:55.716012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:55.769084 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861dae3b1620455a9e55eebbce30a9dd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.769751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861dae3b1620455a9e55eebbce30a9dd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.777308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861dae3b1620455a9e55eebbce30a9dd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.790247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861dae3b1620455a9e55eebbce30a9dd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.791238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-aeb7a8be-a3ef-4378-83e2-1d065e3d7eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861dae3b1620455a9e55eebbce30a9dd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.802931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:55.805318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:55.806680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1307/2592] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:55 2022] DELETE /identity/v3/users/861dae3b1620455a9e55eebbce30a9dd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:55.822189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418ff40-8030-49e9-b184-8e70713aae30 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:55.891388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:55.892154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:55.892462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:55.892583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] PATH_INFO: `/v3/projects/de12824dd02c454580f9ae5a6071a3d5` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:55.894104 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de12824dd02c454580f9ae5a6071a3d5)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:55.896009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:55.947828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de12824dd02c454580f9ae5a6071a3d5', 'request_id': 'req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.954201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de12824dd02c454580f9ae5a6071a3d5', 'request_id': 'req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.960682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de12824dd02c454580f9ae5a6071a3d5', 'request_id': 'req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.971940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] The token cache is being invalidate because project de12824dd02c454580f9ae5a6071a3d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:55.972237 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.972871 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:55.974514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1286/2593] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:55 2022] DELETE /identity/v3/projects/de12824dd02c454580f9ae5a6071a3d5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:55.980742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fe93e-ae2d-4316-b271-1e5eaeadd93e None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:55.981061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fe93e-ae2d-4316-b271-1e5eaeadd93e None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:55.981382 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fe93e-ae2d-4316-b271-1e5eaeadd93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:55.986542 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:55.988021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:56.002474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ab1fe93e-ae2d-4316-b271-1e5eaeadd93e None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:56.003687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ab1fe93e-ae2d-4316-b271-1e5eaeadd93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:56.058148 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e01ef7-fe8e-426b-bf95-c6d9fedcd384 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.062813 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.063439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.063723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.063998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] PATH_INFO: `/v3/projects/0045dc38b8ff487aa433ed15689d5a44` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.065133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0045dc38b8ff487aa433ed15689d5a44)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.066607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1308/2594] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:56.067034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.075936 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788538b1-bfaf-48fd-9253-43a9d06831a0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.076221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788538b1-bfaf-48fd-9253-43a9d06831a0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.076497 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788538b1-bfaf-48fd-9253-43a9d06831a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.097686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-788538b1-bfaf-48fd-9253-43a9d06831a0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:56.098900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-788538b1-bfaf-48fd-9253-43a9d06831a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:56.104034 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:56.108539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1309/2595] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:56.112651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788538b1-bfaf-48fd-9253-43a9d06831a0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.123004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0045dc38b8ff487aa433ed15689d5a44', 'request_id': 'req-935f5ccc-eeae-4870-bb12-3d63c6b53af4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:56.124037 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788538b1-bfaf-48fd-9253-43a9d06831a0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.129641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0045dc38b8ff487aa433ed15689d5a44', 'request_id': 'req-935f5ccc-eeae-4870-bb12-3d63c6b53af4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:56.148705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0045dc38b8ff487aa433ed15689d5a44', 'request_id': 'req-935f5ccc-eeae-4870-bb12-3d63c6b53af4'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:56.152132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:56.165169 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] The token cache is being invalidate because project 0045dc38b8ff487aa433ed15689d5a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:56.165464 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:56.166121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:56.167884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1287/2596] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:55 2022] DELETE /identity/v3/projects/0045dc38b8ff487aa433ed15689d5a44 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:56.195676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed419b38-c8be-4a90-a335-b68e87e0b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.196304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed419b38-c8be-4a90-a335-b68e87e0b655 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.196596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed419b38-c8be-4a90-a335-b68e87e0b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.196852 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed419b38-c8be-4a90-a335-b68e87e0b655 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.197565 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed419b38-c8be-4a90-a335-b68e87e0b655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:42:56.197868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed419b38-c8be-4a90-a335-b68e87e0b655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.199499 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed419b38-c8be-4a90-a335-b68e87e0b655 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.213004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1310/2597] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:42:56.217605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.219051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:56.232912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f5ccc-eeae-4870-bb12-3d63c6b53af4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.237822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee2e5-d4b8-4307-9b01-0674180b3446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.238449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee2e5-d4b8-4307-9b01-0674180b3446 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.238729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee2e5-d4b8-4307-9b01-0674180b3446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.239000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee2e5-d4b8-4307-9b01-0674180b3446 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.239656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ee2e5-d4b8-4307-9b01-0674180b3446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.242327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ee2e5-d4b8-4307-9b01-0674180b3446 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.273560 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1288/2598] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:56 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:42:56.277512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed419b38-c8be-4a90-a335-b68e87e0b655 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.288090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed419b38-c8be-4a90-a335-b68e87e0b655 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.349045 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3231d-181c-4b1d-9783-51715b2c8d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.349690 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3231d-181c-4b1d-9783-51715b2c8d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.349974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3231d-181c-4b1d-9783-51715b2c8d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.350249 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3231d-181c-4b1d-9783-51715b2c8d09 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.351008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3231d-181c-4b1d-9783-51715b2c8d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.352975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3231d-181c-4b1d-9783-51715b2c8d09 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.385562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1311/2599] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:56 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:56.387116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee2e5-d4b8-4307-9b01-0674180b3446 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.399139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee2e5-d4b8-4307-9b01-0674180b3446 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.403940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246585db-7467-4935-bb1c-96d80ff2853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.404593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246585db-7467-4935-bb1c-96d80ff2853c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.405023 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246585db-7467-4935-bb1c-96d80ff2853c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.405300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246585db-7467-4935-bb1c-96d80ff2853c admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.406000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246585db-7467-4935-bb1c-96d80ff2853c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.407604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246585db-7467-4935-bb1c-96d80ff2853c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.418729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1289/2600] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:56.422816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3231d-181c-4b1d-9783-51715b2c8d09 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.433417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3231d-181c-4b1d-9783-51715b2c8d09 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.437975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bf8ca-5ed9-4a92-bfa6-5f8bc0079c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.438560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bf8ca-5ed9-4a92-bfa6-5f8bc0079c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.438839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bf8ca-5ed9-4a92-bfa6-5f8bc0079c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.439114 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bf8ca-5ed9-4a92-bfa6-5f8bc0079c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.439742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bf8ca-5ed9-4a92-bfa6-5f8bc0079c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.441383 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bf8ca-5ed9-4a92-bfa6-5f8bc0079c0b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.452428 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1312/2601] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:56.456291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246585db-7467-4935-bb1c-96d80ff2853c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.466070 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246585db-7467-4935-bb1c-96d80ff2853c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.470571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938215e-b9b4-4e0a-8a06-6f3b31246618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.471199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938215e-b9b4-4e0a-8a06-6f3b31246618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.471585 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938215e-b9b4-4e0a-8a06-6f3b31246618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.471863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938215e-b9b4-4e0a-8a06-6f3b31246618 admin admin] PATH_INFO: `/v3/projects/19348b985870423aa2ca7460a2340564/users/30cf7574ad2f4e1daae21ba7de59bc14/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.486166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938215e-b9b4-4e0a-8a06-6f3b31246618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19348b985870423aa2ca7460a2340564, user_id=30cf7574ad2f4e1daae21ba7de59bc14, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.489692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938215e-b9b4-4e0a-8a06-6f3b31246618 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.503908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1290/2602] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:56 2022] PUT /identity/v3/projects/19348b985870423aa2ca7460a2340564/users/30cf7574ad2f4e1daae21ba7de59bc14/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:56.518589 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0341db-9ac2-4308-8478-3ba8231dc0cd None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.518865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0341db-9ac2-4308-8478-3ba8231dc0cd None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.519141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0341db-9ac2-4308-8478-3ba8231dc0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.546966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0d0341db-9ac2-4308-8478-3ba8231dc0cd None None] MFA Rules not processed for user `30cf7574ad2f4e1daae21ba7de59bc14`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:56.548182 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0d0341db-9ac2-4308-8478-3ba8231dc0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:56.615287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1313/2603] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:56.620312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938215e-b9b4-4e0a-8a06-6f3b31246618 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.682907 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938215e-b9b4-4e0a-8a06-6f3b31246618 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.687640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ed69c-4aae-44cb-bfba-7237d1860215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.688244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed69c-4aae-44cb-bfba-7237d1860215 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.688527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed69c-4aae-44cb-bfba-7237d1860215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.688802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ed69c-4aae-44cb-bfba-7237d1860215 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.689477 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ed69c-4aae-44cb-bfba-7237d1860215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.691365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ed69c-4aae-44cb-bfba-7237d1860215 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.720904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1291/2604] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:56 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:56.722030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0341db-9ac2-4308-8478-3ba8231dc0cd None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.733409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0341db-9ac2-4308-8478-3ba8231dc0cd None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.757896 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:56.791598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21b7c3-d32c-4d16-a1a6-b15ba4e014b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.791962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b7c3-d32c-4d16-a1a6-b15ba4e014b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.792243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b7c3-d32c-4d16-a1a6-b15ba4e014b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.792517 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b7c3-d32c-4d16-a1a6-b15ba4e014b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.793194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21b7c3-d32c-4d16-a1a6-b15ba4e014b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.795090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21b7c3-d32c-4d16-a1a6-b15ba4e014b2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.817243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1314/2605] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:56 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:42:56.821736 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ed69c-4aae-44cb-bfba-7237d1860215 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.831893 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ed69c-4aae-44cb-bfba-7237d1860215 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.838645 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9c386-55b7-428c-bc22-94684431aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.839243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c386-55b7-428c-bc22-94684431aa3c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.839524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c386-55b7-428c-bc22-94684431aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.839793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9c386-55b7-428c-bc22-94684431aa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.840426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9c386-55b7-428c-bc22-94684431aa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.842035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9c386-55b7-428c-bc22-94684431aa3c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.852896 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1292/2606] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:56.857310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21b7c3-d32c-4d16-a1a6-b15ba4e014b2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.867708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21b7c3-d32c-4d16-a1a6-b15ba4e014b2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.872346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7f09-d31d-42f4-80ee-869780418d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.872929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7f09-d31d-42f4-80ee-869780418d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.873253 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7f09-d31d-42f4-80ee-869780418d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.873527 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7f09-d31d-42f4-80ee-869780418d7f admin admin] PATH_INFO: `/v3/projects/b081ec4d3ace407bb3cc18b7a58e592d/users/4d2f133559644e2c91be59e39707e66e/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.888618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7f09-d31d-42f4-80ee-869780418d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b081ec4d3ace407bb3cc18b7a58e592d, user_id=4d2f133559644e2c91be59e39707e66e, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.891343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7f09-d31d-42f4-80ee-869780418d7f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.904286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1315/2607] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:56 2022] PUT /identity/v3/projects/b081ec4d3ace407bb3cc18b7a58e592d/users/4d2f133559644e2c91be59e39707e66e/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:56.908372 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9c386-55b7-428c-bc22-94684431aa3c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:56.922043 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9c386-55b7-428c-bc22-94684431aa3c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:56.955344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:56.981981 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96859154-5d84-4a7d-b1ae-f1ff65c87ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:56.982678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96859154-5d84-4a7d-b1ae-f1ff65c87ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:56.982967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96859154-5d84-4a7d-b1ae-f1ff65c87ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:56.983243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96859154-5d84-4a7d-b1ae-f1ff65c87ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:56.983886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96859154-5d84-4a7d-b1ae-f1ff65c87ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:56.985514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96859154-5d84-4a7d-b1ae-f1ff65c87ad7 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:56.995100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1293/2608] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:56.999317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7f09-d31d-42f4-80ee-869780418d7f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:57.009966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7f09-d31d-42f4-80ee-869780418d7f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:57.014452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850285ef-cf41-4b5e-a243-61dc08940ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:57.015094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850285ef-cf41-4b5e-a243-61dc08940ade admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:57.015376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850285ef-cf41-4b5e-a243-61dc08940ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:57.015649 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850285ef-cf41-4b5e-a243-61dc08940ade admin admin] PATH_INFO: `/v3/projects/b081ec4d3ace407bb3cc18b7a58e592d/users/4d2f133559644e2c91be59e39707e66e/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:57.017580 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850285ef-cf41-4b5e-a243-61dc08940ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=b081ec4d3ace407bb3cc18b7a58e592d, user_id=4d2f133559644e2c91be59e39707e66e, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:57.020192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850285ef-cf41-4b5e-a243-61dc08940ade admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:57.033115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1316/2609] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:56 2022] PUT /identity/v3/projects/b081ec4d3ace407bb3cc18b7a58e592d/users/4d2f133559644e2c91be59e39707e66e/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:57.043180 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d68cdc-a465-4bcf-9e7c-5c68d8859bb8 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:57.043470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d68cdc-a465-4bcf-9e7c-5c68d8859bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:57.043771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d68cdc-a465-4bcf-9e7c-5c68d8859bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:57.071917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e8d68cdc-a465-4bcf-9e7c-5c68d8859bb8 None None] MFA Rules not processed for user `4d2f133559644e2c91be59e39707e66e`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:57.073156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e8d68cdc-a465-4bcf-9e7c-5c68d8859bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:57.139838 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1294/2610] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:57.151778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850285ef-cf41-4b5e-a243-61dc08940ade admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:57.153528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-850285ef-cf41-4b5e-a243-61dc08940ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:57.210756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850285ef-cf41-4b5e-a243-61dc08940ade admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:57.214705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384101f-fefe-4b88-9400-c6cfd1c8a021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:57.215311 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384101f-fefe-4b88-9400-c6cfd1c8a021 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:57.215619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384101f-fefe-4b88-9400-c6cfd1c8a021 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:57.215915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384101f-fefe-4b88-9400-c6cfd1c8a021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:57.226933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384101f-fefe-4b88-9400-c6cfd1c8a021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:57.228728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384101f-fefe-4b88-9400-c6cfd1c8a021 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:57.241483 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1317/2611] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:42:57.626414 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d68cdc-a465-4bcf-9e7c-5c68d8859bb8 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:57.687246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d68cdc-a465-4bcf-9e7c-5c68d8859bb8 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:57.691606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:57.692218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:57.692498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:57.692767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] PATH_INFO: `/v3/users/30cf7574ad2f4e1daae21ba7de59bc14` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:57.693924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30cf7574ad2f4e1daae21ba7de59bc14)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:57.696335 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:57.740997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30cf7574ad2f4e1daae21ba7de59bc14'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:57.748876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30cf7574ad2f4e1daae21ba7de59bc14'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:57.749582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30cf7574ad2f4e1daae21ba7de59bc14'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:57.754101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:57.759022 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30cf7574ad2f4e1daae21ba7de59bc14'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:57.772099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30cf7574ad2f4e1daae21ba7de59bc14'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:57.778529 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1295/2612] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:57 2022] DELETE /identity/v3/users/30cf7574ad2f4e1daae21ba7de59bc14 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:57.782948 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e52c8-6e3b-4b6d-b831-5adee7171625 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:57.783234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e52c8-6e3b-4b6d-b831-5adee7171625 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:57.783539 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e52c8-6e3b-4b6d-b831-5adee7171625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:57.802306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-175e52c8-6e3b-4b6d-b831-5adee7171625 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:57.803486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-175e52c8-6e3b-4b6d-b831-5adee7171625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:57.865351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1318/2613] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:57.875382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:57.876774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:57.932344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1baaed-785d-452a-8d99-ec3be49a4169 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:57.935926 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda36cf-490c-4caf-bda1-04100ca0b015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:57.936517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda36cf-490c-4caf-bda1-04100ca0b015 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:57.936794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda36cf-490c-4caf-bda1-04100ca0b015 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:57.937101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda36cf-490c-4caf-bda1-04100ca0b015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:57.946576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda36cf-490c-4caf-bda1-04100ca0b015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:57.947924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda36cf-490c-4caf-bda1-04100ca0b015 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:57.958238 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1296/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:42:58.228779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e52c8-6e3b-4b6d-b831-5adee7171625 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:58.230222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-175e52c8-6e3b-4b6d-b831-5adee7171625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:58.244608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e52c8-6e3b-4b6d-b831-5adee7171625 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:58.249320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:58.249950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:58.250233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:58.250502 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] PATH_INFO: `/v3/projects/19348b985870423aa2ca7460a2340564` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:58.251614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19348b985870423aa2ca7460a2340564)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:58.253573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:58.270761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:58.301458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19348b985870423aa2ca7460a2340564', 'request_id': 'req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.307337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19348b985870423aa2ca7460a2340564', 'request_id': 'req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.312681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19348b985870423aa2ca7460a2340564', 'request_id': 'req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.325115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] The token cache is being invalidate because project 19348b985870423aa2ca7460a2340564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:58.325400 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.326016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.327450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1319/2615] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:58 2022] DELETE /identity/v3/projects/19348b985870423aa2ca7460a2340564 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:58.331394 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda36cf-490c-4caf-bda1-04100ca0b015 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:58.341655 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda36cf-490c-4caf-bda1-04100ca0b015 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:58.398149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:58.398790 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:58.399085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:58.399339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] PATH_INFO: `/v3/users/4d2f133559644e2c91be59e39707e66e` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:58.400467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2f133559644e2c91be59e39707e66e)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:58.402439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:58.447247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2f133559644e2c91be59e39707e66e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.454027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2f133559644e2c91be59e39707e66e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.454658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2f133559644e2c91be59e39707e66e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.461527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2f133559644e2c91be59e39707e66e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.473163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b82d4e56-a70d-444d-abf1-9ff53b2d97bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2f133559644e2c91be59e39707e66e'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.474475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:58.480765 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1297/2616] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:42:58 2022] DELETE /identity/v3/users/4d2f133559644e2c91be59e39707e66e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:58.757348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:58.758824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:58.771876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d764ee-bd21-42d6-b0bd-762e0e5d3c56 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:58.828886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:58.829544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:58.829820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:58.830096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] PATH_INFO: `/v3/projects/b081ec4d3ace407bb3cc18b7a58e592d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:58.831195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b081ec4d3ace407bb3cc18b7a58e592d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:58.833108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:58.887529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b081ec4d3ace407bb3cc18b7a58e592d', 'request_id': 'req-c4ff4037-7845-4722-8dff-e2f50fe6229b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.894898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b081ec4d3ace407bb3cc18b7a58e592d', 'request_id': 'req-c4ff4037-7845-4722-8dff-e2f50fe6229b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.903459 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b081ec4d3ace407bb3cc18b7a58e592d', 'request_id': 'req-c4ff4037-7845-4722-8dff-e2f50fe6229b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.915070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] The token cache is being invalidate because project b081ec4d3ace407bb3cc18b7a58e592d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:42:58.915369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.916069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c4ff4037-7845-4722-8dff-e2f50fe6229b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:42:58.918012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1320/2617] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:42:58 2022] DELETE /identity/v3/projects/b081ec4d3ace407bb3cc18b7a58e592d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:58.922710 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9dca-014c-4cff-9e03-bab82e7c2601 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:58.922997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9dca-014c-4cff-9e03-bab82e7c2601 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:58.923268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9dca-014c-4cff-9e03-bab82e7c2601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:58.948202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-902e9dca-014c-4cff-9e03-bab82e7c2601 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:58.949442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-902e9dca-014c-4cff-9e03-bab82e7c2601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:59.011127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1298/2618] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:42:59.018617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd44fd4-e52d-4d02-90a1-16564f7fccbc None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.019035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd44fd4-e52d-4d02-90a1-16564f7fccbc None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.019155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd44fd4-e52d-4d02-90a1-16564f7fccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.039813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4fd44fd4-e52d-4d02-90a1-16564f7fccbc None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:59.041052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4fd44fd4-e52d-4d02-90a1-16564f7fccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:59.048914 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1321/2619] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:59.053156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9dca-014c-4cff-9e03-bab82e7c2601 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.063705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9dca-014c-4cff-9e03-bab82e7c2601 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.068313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223251c-b8ba-4ea7-9685-7dd1de8d4cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.068918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223251c-b8ba-4ea7-9685-7dd1de8d4cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.069270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223251c-b8ba-4ea7-9685-7dd1de8d4cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.069545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223251c-b8ba-4ea7-9685-7dd1de8d4cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.070207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223251c-b8ba-4ea7-9685-7dd1de8d4cbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:42:59.070492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223251c-b8ba-4ea7-9685-7dd1de8d4cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.072091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223251c-b8ba-4ea7-9685-7dd1de8d4cbc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.083978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1299/2620] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:42:59.088208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd44fd4-e52d-4d02-90a1-16564f7fccbc None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.097614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd44fd4-e52d-4d02-90a1-16564f7fccbc None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.103406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7fcd0-5f32-4016-9827-4176a378a194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.104012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7fcd0-5f32-4016-9827-4176a378a194 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.104302 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7fcd0-5f32-4016-9827-4176a378a194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.104575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7fcd0-5f32-4016-9827-4176a378a194 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.105355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7fcd0-5f32-4016-9827-4176a378a194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.107324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7fcd0-5f32-4016-9827-4176a378a194 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.140576 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1322/2621] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:59 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:59.141982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223251c-b8ba-4ea7-9685-7dd1de8d4cbc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.152117 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223251c-b8ba-4ea7-9685-7dd1de8d4cbc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.208449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4728e3-58dc-449f-9fdf-720caae503a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.209090 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4728e3-58dc-449f-9fdf-720caae503a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.209381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4728e3-58dc-449f-9fdf-720caae503a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.209740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4728e3-58dc-449f-9fdf-720caae503a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.210380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4728e3-58dc-449f-9fdf-720caae503a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.212310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4728e3-58dc-449f-9fdf-720caae503a4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.233959 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1300/2622] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:59 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:42:59.238047 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7fcd0-5f32-4016-9827-4176a378a194 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.248320 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7fcd0-5f32-4016-9827-4176a378a194 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.252975 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7980bb-4a61-4eb9-b4cb-3f604a48c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.253564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7980bb-4a61-4eb9-b4cb-3f604a48c4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.253846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7980bb-4a61-4eb9-b4cb-3f604a48c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.254124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7980bb-4a61-4eb9-b4cb-3f604a48c4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.254757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7980bb-4a61-4eb9-b4cb-3f604a48c4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.256327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7980bb-4a61-4eb9-b4cb-3f604a48c4f8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.258126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:59.268258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1323/2623] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:59.271863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4728e3-58dc-449f-9fdf-720caae503a4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.281851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4728e3-58dc-449f-9fdf-720caae503a4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.286473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d21c0-d3ae-4d27-993f-f6d3c36273aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.287084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d21c0-d3ae-4d27-993f-f6d3c36273aa admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.287389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d21c0-d3ae-4d27-993f-f6d3c36273aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.287708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d21c0-d3ae-4d27-993f-f6d3c36273aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.288384 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d21c0-d3ae-4d27-993f-f6d3c36273aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.290115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d21c0-d3ae-4d27-993f-f6d3c36273aa admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.300469 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1301/2624] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:59.305144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7980bb-4a61-4eb9-b4cb-3f604a48c4f8 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.315108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7980bb-4a61-4eb9-b4cb-3f604a48c4f8 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.320343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818d7d-1ec0-473d-8d9a-3a9354263f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.321015 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818d7d-1ec0-473d-8d9a-3a9354263f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.321302 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818d7d-1ec0-473d-8d9a-3a9354263f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.321605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818d7d-1ec0-473d-8d9a-3a9354263f50 admin admin] PATH_INFO: `/v3/projects/d341b35b7e53469ea1666c94982f669c/users/25b5e4163cda49aa900fe66b45c6eadd/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.336386 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08818d7d-1ec0-473d-8d9a-3a9354263f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d341b35b7e53469ea1666c94982f669c, user_id=25b5e4163cda49aa900fe66b45c6eadd, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.339021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08818d7d-1ec0-473d-8d9a-3a9354263f50 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.351735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1324/2625] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:59 2022] PUT /identity/v3/projects/d341b35b7e53469ea1666c94982f669c/users/25b5e4163cda49aa900fe66b45c6eadd/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:59.362260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835e34-80de-4355-83c7-f294119400f5 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.362784 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835e34-80de-4355-83c7-f294119400f5 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.362886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835e34-80de-4355-83c7-f294119400f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.392173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e0835e34-80de-4355-83c7-f294119400f5 None None] MFA Rules not processed for user `25b5e4163cda49aa900fe66b45c6eadd`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:59.393518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e0835e34-80de-4355-83c7-f294119400f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:59.447590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:59.458547 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1302/2626] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:59.463650 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818d7d-1ec0-473d-8d9a-3a9354263f50 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.525238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818d7d-1ec0-473d-8d9a-3a9354263f50 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.529914 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58465c76-5fdc-439d-805c-367ac60fe198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.530511 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465c76-5fdc-439d-805c-367ac60fe198 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.530795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465c76-5fdc-439d-805c-367ac60fe198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.531074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465c76-5fdc-439d-805c-367ac60fe198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.531704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58465c76-5fdc-439d-805c-367ac60fe198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.533638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58465c76-5fdc-439d-805c-367ac60fe198 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.561690 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1325/2627] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:42:59 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:42:59.565779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0835e34-80de-4355-83c7-f294119400f5 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.576805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0835e34-80de-4355-83c7-f294119400f5 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.631894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea8f21-a4c6-47d9-a56d-79ec427f0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.632521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea8f21-a4c6-47d9-a56d-79ec427f0e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.632803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea8f21-a4c6-47d9-a56d-79ec427f0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.633112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea8f21-a4c6-47d9-a56d-79ec427f0e49 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.633740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea8f21-a4c6-47d9-a56d-79ec427f0e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.635650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea8f21-a4c6-47d9-a56d-79ec427f0e49 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.655254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1303/2628] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:42:59 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:42:59.659411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58465c76-5fdc-439d-805c-367ac60fe198 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.670388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58465c76-5fdc-439d-805c-367ac60fe198 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.674918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d02417-74da-46d8-8256-739e3bdf9a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.675510 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d02417-74da-46d8-8256-739e3bdf9a1a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.675785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d02417-74da-46d8-8256-739e3bdf9a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.676056 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d02417-74da-46d8-8256-739e3bdf9a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.676689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d02417-74da-46d8-8256-739e3bdf9a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.678396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d02417-74da-46d8-8256-739e3bdf9a1a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.688818 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1326/2629] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:59.692738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea8f21-a4c6-47d9-a56d-79ec427f0e49 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.703563 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea8f21-a4c6-47d9-a56d-79ec427f0e49 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.708373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d121660-5c4b-4c03-b5e7-842cd10099c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.709052 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d121660-5c4b-4c03-b5e7-842cd10099c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.709336 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d121660-5c4b-4c03-b5e7-842cd10099c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.709660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d121660-5c4b-4c03-b5e7-842cd10099c4 admin admin] PATH_INFO: `/v3/projects/557d52ca6efb47bca83d54c1926a0493/users/5a845fd945ed49d28d0497f05b69ac99/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.723979 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d121660-5c4b-4c03-b5e7-842cd10099c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557d52ca6efb47bca83d54c1926a0493, user_id=5a845fd945ed49d28d0497f05b69ac99, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.727170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d121660-5c4b-4c03-b5e7-842cd10099c4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.739632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1304/2630] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:59 2022] PUT /identity/v3/projects/557d52ca6efb47bca83d54c1926a0493/users/5a845fd945ed49d28d0497f05b69ac99/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:42:59.744135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d02417-74da-46d8-8256-739e3bdf9a1a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.753801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d02417-74da-46d8-8256-739e3bdf9a1a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.809094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084875ab-51d2-4460-805b-491d4d05c47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.809630 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084875ab-51d2-4460-805b-491d4d05c47f admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.809910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084875ab-51d2-4460-805b-491d4d05c47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.810214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084875ab-51d2-4460-805b-491d4d05c47f admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.810848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084875ab-51d2-4460-805b-491d4d05c47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.812408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084875ab-51d2-4460-805b-491d4d05c47f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.822518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1327/2631] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:42:59.826578 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d121660-5c4b-4c03-b5e7-842cd10099c4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.837243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d121660-5c4b-4c03-b5e7-842cd10099c4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:42:59.841858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185159ce-cde0-465b-841b-8e26e15ec92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:42:59.842503 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185159ce-cde0-465b-841b-8e26e15ec92f admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.842786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185159ce-cde0-465b-841b-8e26e15ec92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.843064 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185159ce-cde0-465b-841b-8e26e15ec92f admin admin] PATH_INFO: `/v3/projects/557d52ca6efb47bca83d54c1926a0493/users/5a845fd945ed49d28d0497f05b69ac99/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.845002 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185159ce-cde0-465b-841b-8e26e15ec92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=557d52ca6efb47bca83d54c1926a0493, user_id=5a845fd945ed49d28d0497f05b69ac99, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:42:59.847649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185159ce-cde0-465b-841b-8e26e15ec92f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:42:59.860261 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1305/2632] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:42:59 2022] PUT /identity/v3/projects/557d52ca6efb47bca83d54c1926a0493/users/5a845fd945ed49d28d0497f05b69ac99/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:42:59.871765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225ef6e-992c-46f6-8439-e3567e9fc0d5 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:42:59.872052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225ef6e-992c-46f6-8439-e3567e9fc0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:42:59.872322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225ef6e-992c-46f6-8439-e3567e9fc0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:42:59.900108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9225ef6e-992c-46f6-8439-e3567e9fc0d5 None None] MFA Rules not processed for user `5a845fd945ed49d28d0497f05b69ac99`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:42:59.901346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9225ef6e-992c-46f6-8439-e3567e9fc0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:42:59.932263 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:59.972749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1328/2633] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:42:59.985196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185159ce-cde0-465b-841b-8e26e15ec92f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:42:59.986823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-185159ce-cde0-465b-841b-8e26e15ec92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:00.047894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185159ce-cde0-465b-841b-8e26e15ec92f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:00.051539 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7346f37-f685-48d7-9980-18e53e08625d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:00.052149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7346f37-f685-48d7-9980-18e53e08625d service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:00.052426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7346f37-f685-48d7-9980-18e53e08625d service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:00.052698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7346f37-f685-48d7-9980-18e53e08625d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:00.062200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7346f37-f685-48d7-9980-18e53e08625d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:00.063540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7346f37-f685-48d7-9980-18e53e08625d service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:00.073701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1306/2634] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:42:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:00.149194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225ef6e-992c-46f6-8439-e3567e9fc0d5 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:00.158885 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225ef6e-992c-46f6-8439-e3567e9fc0d5 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:00.162637 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347be089-f293-493e-9b16-9757b384bbc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:00.163258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347be089-f293-493e-9b16-9757b384bbc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:00.163611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347be089-f293-493e-9b16-9757b384bbc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:00.163909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347be089-f293-493e-9b16-9757b384bbc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:00.224413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347be089-f293-493e-9b16-9757b384bbc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:00.226497 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347be089-f293-493e-9b16-9757b384bbc6 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:00.235800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1329/2635] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:02.945850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7346f37-f685-48d7-9980-18e53e08625d service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:02.994422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:03.009192 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7346f37-f685-48d7-9980-18e53e08625d service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:03.013685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:03.014301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:03.014579 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:03.014849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] PATH_INFO: `/v3/users/25b5e4163cda49aa900fe66b45c6eadd` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:03.015943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b5e4163cda49aa900fe66b45c6eadd)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:03.017881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:03.063131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b5e4163cda49aa900fe66b45c6eadd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.069829 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b5e4163cda49aa900fe66b45c6eadd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.070691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b5e4163cda49aa900fe66b45c6eadd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.077545 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b5e4163cda49aa900fe66b45c6eadd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.089488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b5e4163cda49aa900fe66b45c6eadd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.095067 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1307/2636] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:02 2022] DELETE /identity/v3/users/25b5e4163cda49aa900fe66b45c6eadd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:03.099828 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c640c2-68a9-470b-a474-f71d8708dd01 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:03.100370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c640c2-68a9-470b-a474-f71d8708dd01 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:03.100370 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c640c2-68a9-470b-a474-f71d8708dd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:03.119322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b5c640c2-68a9-470b-a474-f71d8708dd01 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:03.120542 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b5c640c2-68a9-470b-a474-f71d8708dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:03.180104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1330/2637] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:03.189780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:03.191231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:03.247935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabda622-57ca-46b8-8dfb-2b05a221aa6e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:03.251577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf305f4-8d17-4587-a681-e0f8f441f1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:03.252165 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf305f4-8d17-4587-a681-e0f8f441f1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:03.252439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf305f4-8d17-4587-a681-e0f8f441f1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:03.252707 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf305f4-8d17-4587-a681-e0f8f441f1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:03.262100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf305f4-8d17-4587-a681-e0f8f441f1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:03.263524 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf305f4-8d17-4587-a681-e0f8f441f1c4 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:03.273508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1308/2638] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:03.473348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c640c2-68a9-470b-a474-f71d8708dd01 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:03.474849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b5c640c2-68a9-470b-a474-f71d8708dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:03.486959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c640c2-68a9-470b-a474-f71d8708dd01 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:03.491804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:03.492440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:03.492716 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:03.493012 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] PATH_INFO: `/v3/users/d3a16e68b4a74de3ac26186d1d09cee2` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:03.494123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a16e68b4a74de3ac26186d1d09cee2)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:03.496009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:03.540091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf305f4-8d17-4587-a681-e0f8f441f1c4 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:03.541897 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4bf305f4-8d17-4587-a681-e0f8f441f1c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:03.546859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a16e68b4a74de3ac26186d1d09cee2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.547509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a16e68b4a74de3ac26186d1d09cee2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.555123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf305f4-8d17-4587-a681-e0f8f441f1c4 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:03.555665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a16e68b4a74de3ac26186d1d09cee2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.560293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:03.561704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:03.562474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:03.562869 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:03.563197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] PATH_INFO: `/v3/projects/d341b35b7e53469ea1666c94982f669c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:03.564935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d341b35b7e53469ea1666c94982f669c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:03.566934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:03.572769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a16e68b4a74de3ac26186d1d09cee2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.573643 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-e0cab893-08d4-4ec6-835d-98ac37a396e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a16e68b4a74de3ac26186d1d09cee2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.589214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1331/2639] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:03 2022] DELETE /identity/v3/users/d3a16e68b4a74de3ac26186d1d09cee2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:03.593523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f0411-87bb-4dfd-8b44-b74f994129ab None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:03.594010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f0411-87bb-4dfd-8b44-b74f994129ab None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:03.594284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f0411-87bb-4dfd-8b44-b74f994129ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:03.613359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-037f0411-87bb-4dfd-8b44-b74f994129ab None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:03.614585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-037f0411-87bb-4dfd-8b44-b74f994129ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:03.618583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd341b35b7e53469ea1666c94982f669c', 'request_id': 'req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.625025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd341b35b7e53469ea1666c94982f669c', 'request_id': 'req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.631095 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd341b35b7e53469ea1666c94982f669c', 'request_id': 'req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.633996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:03.646492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] The token cache is being invalidate because project d341b35b7e53469ea1666c94982f669c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:03.646903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.647530 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.649264 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1309/2640] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:03 2022] DELETE /identity/v3/projects/d341b35b7e53469ea1666c94982f669c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:03.652810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:03.654199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:03.675158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1332/2641] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:03.685910 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f0411-87bb-4dfd-8b44-b74f994129ab None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:03.687231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-037f0411-87bb-4dfd-8b44-b74f994129ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:03.720041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51345670-5dc6-4ebf-8b8d-5b4d5b185afd admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:03.725218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:03.725842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:03.726123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:03.726399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] PATH_INFO: `/v3/users/5a845fd945ed49d28d0497f05b69ac99` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:03.727801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a845fd945ed49d28d0497f05b69ac99)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:03.729747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:03.744172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f0411-87bb-4dfd-8b44-b74f994129ab None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:03.748087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbe85b-1871-4a13-817e-35f73847d595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:03.748711 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbe85b-1871-4a13-817e-35f73847d595 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:03.749041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbe85b-1871-4a13-817e-35f73847d595 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:03.749310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbe85b-1871-4a13-817e-35f73847d595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:03.760679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbe85b-1871-4a13-817e-35f73847d595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:03.762200 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbe85b-1871-4a13-817e-35f73847d595 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:03.773869 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1333/2642] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:03.778815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a845fd945ed49d28d0497f05b69ac99'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.786402 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a845fd945ed49d28d0497f05b69ac99'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.787247 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a845fd945ed49d28d0497f05b69ac99'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.794706 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a845fd945ed49d28d0497f05b69ac99'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.808113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a845fd945ed49d28d0497f05b69ac99'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:03.814413 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1310/2643] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:03 2022] DELETE /identity/v3/users/5a845fd945ed49d28d0497f05b69ac99 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:04.102781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbe85b-1871-4a13-817e-35f73847d595 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.104227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-37cbe85b-1871-4a13-817e-35f73847d595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:04.117379 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbe85b-1871-4a13-817e-35f73847d595 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.155576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.157714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:04.188651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.189316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.189594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.190160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] PATH_INFO: `/v3/projects/2b7fcc584bda4eaa8f26f6bf32a589aa` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.191066 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7fcc584bda4eaa8f26f6bf32a589aa)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.193135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.218811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:04.231751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38cbb2-e9f9-4a5a-b838-115b19927b6c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.244644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7fcc584bda4eaa8f26f6bf32a589aa', 'request_id': 'req-251fa440-5e8f-473a-9769-44c54a71a1cd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:04.248660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:04.251316 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7fcc584bda4eaa8f26f6bf32a589aa', 'request_id': 'req-251fa440-5e8f-473a-9769-44c54a71a1cd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:04.257579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7fcc584bda4eaa8f26f6bf32a589aa', 'request_id': 'req-251fa440-5e8f-473a-9769-44c54a71a1cd'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:04.272420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] The token cache is being invalidate because project 2b7fcc584bda4eaa8f26f6bf32a589aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:04.272708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:04.273341 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-251fa440-5e8f-473a-9769-44c54a71a1cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:04.274816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1334/2644] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:04 2022] DELETE /identity/v3/projects/2b7fcc584bda4eaa8f26f6bf32a589aa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:04.279627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ca0a-2215-47e7-8bf2-aeb4c0e9aae3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.279919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ca0a-2215-47e7-8bf2-aeb4c0e9aae3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.280315 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ca0a-2215-47e7-8bf2-aeb4c0e9aae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.293666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.294301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.294583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.294851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] PATH_INFO: `/v3/projects/557d52ca6efb47bca83d54c1926a0493` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.295989 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=557d52ca6efb47bca83d54c1926a0493)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.297920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.299390 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9e00ca0a-2215-47e7-8bf2-aeb4c0e9aae3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:04.300588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9e00ca0a-2215-47e7-8bf2-aeb4c0e9aae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:04.308728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1335/2645] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:04.317885 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867390a7-d235-4e49-a3f2-012b186d83e6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.318172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867390a7-d235-4e49-a3f2-012b186d83e6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.318446 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867390a7-d235-4e49-a3f2-012b186d83e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.338060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-867390a7-d235-4e49-a3f2-012b186d83e6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:04.339257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-867390a7-d235-4e49-a3f2-012b186d83e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:04.345485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557d52ca6efb47bca83d54c1926a0493', 'request_id': 'req-25176bb0-ac62-441b-9dcb-f80ce432a8be'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:04.352528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557d52ca6efb47bca83d54c1926a0493', 'request_id': 'req-25176bb0-ac62-441b-9dcb-f80ce432a8be'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:04.363442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557d52ca6efb47bca83d54c1926a0493', 'request_id': 'req-25176bb0-ac62-441b-9dcb-f80ce432a8be'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:04.380060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] The token cache is being invalidate because project 557d52ca6efb47bca83d54c1926a0493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:04.380350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:04.381021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-25176bb0-ac62-441b-9dcb-f80ce432a8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:04.382588 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1311/2646] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:04 2022] DELETE /identity/v3/projects/557d52ca6efb47bca83d54c1926a0493 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:04.387190 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52641b-d8e0-4e26-a6e5-f114df0e3b78 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.387690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52641b-d8e0-4e26-a6e5-f114df0e3b78 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.387968 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52641b-d8e0-4e26-a6e5-f114df0e3b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.402645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1336/2647] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:04.406941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867390a7-d235-4e49-a3f2-012b186d83e6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.408180 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-db52641b-d8e0-4e26-a6e5-f114df0e3b78 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:04.409436 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-db52641b-d8e0-4e26-a6e5-f114df0e3b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:04.416332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867390a7-d235-4e49-a3f2-012b186d83e6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.418873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1312/2648] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:04.425208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79ae71-b648-469f-9a33-925c20bddaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.425797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79ae71-b648-469f-9a33-925c20bddaca admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.426074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79ae71-b648-469f-9a33-925c20bddaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.426196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a613547-93a1-4014-a69d-f00b5865d4b0 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.426348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79ae71-b648-469f-9a33-925c20bddaca admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.426455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a613547-93a1-4014-a69d-f00b5865d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.426802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a613547-93a1-4014-a69d-f00b5865d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.427090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79ae71-b648-469f-9a33-925c20bddaca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:43:04.427391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79ae71-b648-469f-9a33-925c20bddaca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.428967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79ae71-b648-469f-9a33-925c20bddaca admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.444434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1337/2649] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:43:04.445671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79ae71-b648-469f-9a33-925c20bddaca admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.446283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-0a613547-93a1-4014-a69d-f00b5865d4b0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:04.447471 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0a613547-93a1-4014-a69d-f00b5865d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:04.455096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79ae71-b648-469f-9a33-925c20bddaca admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.455360 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1313/2650] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:04.460082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a613547-93a1-4014-a69d-f00b5865d4b0 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.460644 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec5f9e-64b9-4c2b-8e69-ff79699970e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.461298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec5f9e-64b9-4c2b-8e69-ff79699970e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.461597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec5f9e-64b9-4c2b-8e69-ff79699970e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.461881 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec5f9e-64b9-4c2b-8e69-ff79699970e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.462537 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec5f9e-64b9-4c2b-8e69-ff79699970e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.464534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec5f9e-64b9-4c2b-8e69-ff79699970e8 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.469183 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a613547-93a1-4014-a69d-f00b5865d4b0 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.474275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd547d30-4b67-4103-8ed9-3c565989fb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.474850 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd547d30-4b67-4103-8ed9-3c565989fb4e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.475127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd547d30-4b67-4103-8ed9-3c565989fb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.475396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd547d30-4b67-4103-8ed9-3c565989fb4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.476027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd547d30-4b67-4103-8ed9-3c565989fb4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:43:04.476338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd547d30-4b67-4103-8ed9-3c565989fb4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.478217 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd547d30-4b67-4103-8ed9-3c565989fb4e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.491370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1314/2651] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:43:04.495223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd547d30-4b67-4103-8ed9-3c565989fb4e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.495605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1338/2652] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:04.499607 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec5f9e-64b9-4c2b-8e69-ff79699970e8 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.505476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd547d30-4b67-4103-8ed9-3c565989fb4e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.561853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cca061-120d-4240-9ce9-451896edd55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.562485 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca061-120d-4240-9ce9-451896edd55a admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.562601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec5f9e-64b9-4c2b-8e69-ff79699970e8 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.562786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca061-120d-4240-9ce9-451896edd55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.563040 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca061-120d-4240-9ce9-451896edd55a admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.563664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cca061-120d-4240-9ce9-451896edd55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.565648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cca061-120d-4240-9ce9-451896edd55a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.567447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b819fcb-e729-4e9f-bf8b-90ff93430963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.568109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b819fcb-e729-4e9f-bf8b-90ff93430963 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.568328 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b819fcb-e729-4e9f-bf8b-90ff93430963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.568611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b819fcb-e729-4e9f-bf8b-90ff93430963 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.569264 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b819fcb-e729-4e9f-bf8b-90ff93430963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.571150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b819fcb-e729-4e9f-bf8b-90ff93430963 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.588698 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:04.597686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1339/2653] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:04.598777 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b819fcb-e729-4e9f-bf8b-90ff93430963 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.601084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1315/2654] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:04.602100 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cca061-120d-4240-9ce9-451896edd55a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.609856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b819fcb-e729-4e9f-bf8b-90ff93430963 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.611224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:04.665542 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cca061-120d-4240-9ce9-451896edd55a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.667271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25097786-ddc7-4b7d-9c5c-178728c6336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.667873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097786-ddc7-4b7d-9c5c-178728c6336b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.668155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097786-ddc7-4b7d-9c5c-178728c6336b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.668433 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097786-ddc7-4b7d-9c5c-178728c6336b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.669105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25097786-ddc7-4b7d-9c5c-178728c6336b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.670488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da623cd-3fa0-425c-9d45-cef8afe6f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.670679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25097786-ddc7-4b7d-9c5c-178728c6336b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.671082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da623cd-3fa0-425c-9d45-cef8afe6f26e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.671364 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da623cd-3fa0-425c-9d45-cef8afe6f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.671636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da623cd-3fa0-425c-9d45-cef8afe6f26e admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.672258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da623cd-3fa0-425c-9d45-cef8afe6f26e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.674195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da623cd-3fa0-425c-9d45-cef8afe6f26e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.681017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1340/2655] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:43:04.684810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25097786-ddc7-4b7d-9c5c-178728c6336b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.694473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25097786-ddc7-4b7d-9c5c-178728c6336b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.698493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1316/2656] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:04.699255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8254c-94d3-4e1f-91c7-0cd6047976cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.699868 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8254c-94d3-4e1f-91c7-0cd6047976cd admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.700149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8254c-94d3-4e1f-91c7-0cd6047976cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.700426 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8254c-94d3-4e1f-91c7-0cd6047976cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.701097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8254c-94d3-4e1f-91c7-0cd6047976cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.702575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da623cd-3fa0-425c-9d45-cef8afe6f26e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.702700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8254c-94d3-4e1f-91c7-0cd6047976cd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.713095 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da623cd-3fa0-425c-9d45-cef8afe6f26e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.716800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1341/2657] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:04.717798 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8254c-94d3-4e1f-91c7-0cd6047976cd admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.720533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaddf05-89be-4f67-b94d-bef0a2721388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.721179 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaddf05-89be-4f67-b94d-bef0a2721388 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.721501 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaddf05-89be-4f67-b94d-bef0a2721388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.721811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaddf05-89be-4f67-b94d-bef0a2721388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.722478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaddf05-89be-4f67-b94d-bef0a2721388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.724200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaddf05-89be-4f67-b94d-bef0a2721388 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.727958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8254c-94d3-4e1f-91c7-0cd6047976cd admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.732980 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4ea17-db29-482c-af2f-9b1d63e6bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.733634 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ea17-db29-482c-af2f-9b1d63e6bfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.733915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ea17-db29-482c-af2f-9b1d63e6bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.734187 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ea17-db29-482c-af2f-9b1d63e6bfd1 admin admin] PATH_INFO: `/v3/projects/8a7d4c47ccd34baa8eeedfb8d792d218/users/a8bdf5cf387c4938b300fcf67d1d43f7/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.734660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1317/2658] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:04.738489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaddf05-89be-4f67-b94d-bef0a2721388 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.748936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaddf05-89be-4f67-b94d-bef0a2721388 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.751771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4ea17-db29-482c-af2f-9b1d63e6bfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7d4c47ccd34baa8eeedfb8d792d218, user_id=a8bdf5cf387c4938b300fcf67d1d43f7, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.753913 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7da59c-5837-4ee8-a185-78cd1eec527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.754440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4ea17-db29-482c-af2f-9b1d63e6bfd1 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.754572 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7da59c-5837-4ee8-a185-78cd1eec527d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.754993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7da59c-5837-4ee8-a185-78cd1eec527d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.755301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7da59c-5837-4ee8-a185-78cd1eec527d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.755948 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7da59c-5837-4ee8-a185-78cd1eec527d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.757590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7da59c-5837-4ee8-a185-78cd1eec527d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.767593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1342/2659] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:04 2022] PUT /identity/v3/projects/8a7d4c47ccd34baa8eeedfb8d792d218/users/a8bdf5cf387c4938b300fcf67d1d43f7/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:04.772321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1318/2660] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:04.773687 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4ea17-db29-482c-af2f-9b1d63e6bfd1 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.778006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2636e-cdd7-4bbd-b177-c7ac32171331 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.778397 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2636e-cdd7-4bbd-b177-c7ac32171331 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.778771 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2636e-cdd7-4bbd-b177-c7ac32171331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.807042 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-93c2636e-cdd7-4bbd-b177-c7ac32171331 None None] MFA Rules not processed for user `a8bdf5cf387c4938b300fcf67d1d43f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:04.808255 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-93c2636e-cdd7-4bbd-b177-c7ac32171331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:04.835941 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4ea17-db29-482c-af2f-9b1d63e6bfd1 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.840663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954018cb-1958-4ffc-9496-2832d61b9704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.842167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954018cb-1958-4ffc-9496-2832d61b9704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.842167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954018cb-1958-4ffc-9496-2832d61b9704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.842167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954018cb-1958-4ffc-9496-2832d61b9704 admin admin] PATH_INFO: `/v3/projects/f1940ec13ddf4255beb800c082bd31ea/users/5ed0989e9e5445518afe77d89c03d7e9/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.856420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954018cb-1958-4ffc-9496-2832d61b9704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1940ec13ddf4255beb800c082bd31ea, user_id=5ed0989e9e5445518afe77d89c03d7e9, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.859119 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954018cb-1958-4ffc-9496-2832d61b9704 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.873344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1343/2661] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:04 2022] PUT /identity/v3/projects/f1940ec13ddf4255beb800c082bd31ea/users/5ed0989e9e5445518afe77d89c03d7e9/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:04.873671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1319/2662] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:04.877887 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954018cb-1958-4ffc-9496-2832d61b9704 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.883497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff930e-ae11-44a1-8a8a-44463584f56b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.883909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff930e-ae11-44a1-8a8a-44463584f56b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.884190 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff930e-ae11-44a1-8a8a-44463584f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.913138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d5ff930e-ae11-44a1-8a8a-44463584f56b None None] MFA Rules not processed for user `5ed0989e9e5445518afe77d89c03d7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:04.914494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d5ff930e-ae11-44a1-8a8a-44463584f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:04.925935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:04.944075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954018cb-1958-4ffc-9496-2832d61b9704 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:04.949075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7414554-5d11-4e98-a22b-c9492e31dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:04.949735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7414554-5d11-4e98-a22b-c9492e31dbbc admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:04.950057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7414554-5d11-4e98-a22b-c9492e31dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:04.950358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7414554-5d11-4e98-a22b-c9492e31dbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:04.951060 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7414554-5d11-4e98-a22b-c9492e31dbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:04.953135 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7414554-5d11-4e98-a22b-c9492e31dbbc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:04.971567 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:04.982387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1344/2663] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:04.983141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1320/2664] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:04.986658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7414554-5d11-4e98-a22b-c9492e31dbbc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.987327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff930e-ae11-44a1-8a8a-44463584f56b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:04.998140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff930e-ae11-44a1-8a8a-44463584f56b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.048938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7414554-5d11-4e98-a22b-c9492e31dbbc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.053618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62424c-f8cd-4470-a401-cf8c11b705dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.054216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62424c-f8cd-4470-a401-cf8c11b705dd admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.054412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af736530-820d-46b9-966d-bdeb795ab456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.054540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62424c-f8cd-4470-a401-cf8c11b705dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.054763 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62424c-f8cd-4470-a401-cf8c11b705dd admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.055016 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af736530-820d-46b9-966d-bdeb795ab456 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.055298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af736530-820d-46b9-966d-bdeb795ab456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.055394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62424c-f8cd-4470-a401-cf8c11b705dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.055573 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af736530-820d-46b9-966d-bdeb795ab456 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.056201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af736530-820d-46b9-966d-bdeb795ab456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.057417 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62424c-f8cd-4470-a401-cf8c11b705dd admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.058109 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af736530-820d-46b9-966d-bdeb795ab456 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.079688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1345/2665] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:05.083728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62424c-f8cd-4470-a401-cf8c11b705dd admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.089697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1321/2666] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:04 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:05.090930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af736530-820d-46b9-966d-bdeb795ab456 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.093381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62424c-f8cd-4470-a401-cf8c11b705dd admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.153620 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76265167-7a07-4eec-8013-203a23050064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.154360 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76265167-7a07-4eec-8013-203a23050064 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.154557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76265167-7a07-4eec-8013-203a23050064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.154786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af736530-820d-46b9-966d-bdeb795ab456 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.154901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76265167-7a07-4eec-8013-203a23050064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.155457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76265167-7a07-4eec-8013-203a23050064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.157072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76265167-7a07-4eec-8013-203a23050064 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.159454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649eb45-e109-4f84-93b1-6261931b0bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.160044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649eb45-e109-4f84-93b1-6261931b0bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.160321 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649eb45-e109-4f84-93b1-6261931b0bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.160591 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649eb45-e109-4f84-93b1-6261931b0bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.161767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649eb45-e109-4f84-93b1-6261931b0bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.163652 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649eb45-e109-4f84-93b1-6261931b0bf5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.170425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1346/2667] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:05.171621 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76265167-7a07-4eec-8013-203a23050064 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.183494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76265167-7a07-4eec-8013-203a23050064 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.187777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1322/2668] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:05 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:05.188436 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f252-347b-4b7e-a10a-18c55725e14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.188909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649eb45-e109-4f84-93b1-6261931b0bf5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.189055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f252-347b-4b7e-a10a-18c55725e14a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.189333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f252-347b-4b7e-a10a-18c55725e14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.189605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f252-347b-4b7e-a10a-18c55725e14a admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.190241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977f252-347b-4b7e-a10a-18c55725e14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.191808 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977f252-347b-4b7e-a10a-18c55725e14a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.198903 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649eb45-e109-4f84-93b1-6261931b0bf5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.202686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1347/2669] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:05.203892 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd14af-661e-400a-8132-8cd495697501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.204500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd14af-661e-400a-8132-8cd495697501 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.204822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd14af-661e-400a-8132-8cd495697501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.205163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd14af-661e-400a-8132-8cd495697501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.205820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd14af-661e-400a-8132-8cd495697501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.206797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f252-347b-4b7e-a10a-18c55725e14a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.207442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd14af-661e-400a-8132-8cd495697501 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.216408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f252-347b-4b7e-a10a-18c55725e14a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.218828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1323/2670] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:05.222846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd14af-661e-400a-8132-8cd495697501 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.224489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303ba9a-6c45-4639-b8d1-53e144abc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.225165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ba9a-6c45-4639-b8d1-53e144abc812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.225448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ba9a-6c45-4639-b8d1-53e144abc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.225722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ba9a-6c45-4639-b8d1-53e144abc812 admin admin] PATH_INFO: `/v3/projects/3c30862cb96d4314be6d3420ee8249f5/users/9d2dffee8b1d4209acec8e667d7b67fc/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.233494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd14af-661e-400a-8132-8cd495697501 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.238298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c3b9-a9ee-421b-93f6-5556648c9ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.239520 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c3b9-a9ee-421b-93f6-5556648c9ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.239798 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c3b9-a9ee-421b-93f6-5556648c9ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.240068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c3b9-a9ee-421b-93f6-5556648c9ec4 admin admin] PATH_INFO: `/v3/projects/ddac56f4d6f04b488884b3d561b8c03c/users/aa0acebe6a38412b90bc7e88a57d3b13/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.241876 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303ba9a-6c45-4639-b8d1-53e144abc812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c30862cb96d4314be6d3420ee8249f5, user_id=9d2dffee8b1d4209acec8e667d7b67fc, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.244585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303ba9a-6c45-4639-b8d1-53e144abc812 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.254886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48c3b9-a9ee-421b-93f6-5556648c9ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddac56f4d6f04b488884b3d561b8c03c, user_id=aa0acebe6a38412b90bc7e88a57d3b13, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.257533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48c3b9-a9ee-421b-93f6-5556648c9ec4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.258396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1348/2671] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:05 2022] PUT /identity/v3/projects/3c30862cb96d4314be6d3420ee8249f5/users/9d2dffee8b1d4209acec8e667d7b67fc/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:05.269618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346b8e2-53e8-446f-af90-9a2a8ed5a7c0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.269908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346b8e2-53e8-446f-af90-9a2a8ed5a7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.270708 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346b8e2-53e8-446f-af90-9a2a8ed5a7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.272928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1324/2672] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:05 2022] PUT /identity/v3/projects/ddac56f4d6f04b488884b3d561b8c03c/users/aa0acebe6a38412b90bc7e88a57d3b13/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:05.276575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c3b9-a9ee-421b-93f6-5556648c9ec4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.302314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-0346b8e2-53e8-446f-af90-9a2a8ed5a7c0 None None] MFA Rules not processed for user `9d2dffee8b1d4209acec8e667d7b67fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:05.303449 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0346b8e2-53e8-446f-af90-9a2a8ed5a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:05.311555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:05.317845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:05.345626 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c3b9-a9ee-421b-93f6-5556648c9ec4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.350396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df762-9511-44f2-a66c-062081bac4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.351001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df762-9511-44f2-a66c-062081bac4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.351538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df762-9511-44f2-a66c-062081bac4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.351808 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df762-9511-44f2-a66c-062081bac4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.352446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48df762-9511-44f2-a66c-062081bac4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.354111 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48df762-9511-44f2-a66c-062081bac4fb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.373806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1325/2673] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:05.377636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df762-9511-44f2-a66c-062081bac4fb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.380881 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1349/2674] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:05.385203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346b8e2-53e8-446f-af90-9a2a8ed5a7c0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.388764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df762-9511-44f2-a66c-062081bac4fb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.393603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d98ed0-db84-4fa2-a927-623e758bfcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.394405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d98ed0-db84-4fa2-a927-623e758bfcf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.394687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d98ed0-db84-4fa2-a927-623e758bfcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.394985 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d98ed0-db84-4fa2-a927-623e758bfcf4 admin admin] PATH_INFO: `/v3/projects/ddac56f4d6f04b488884b3d561b8c03c/users/aa0acebe6a38412b90bc7e88a57d3b13/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.395503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346b8e2-53e8-446f-af90-9a2a8ed5a7c0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.396881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d98ed0-db84-4fa2-a927-623e758bfcf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddac56f4d6f04b488884b3d561b8c03c, user_id=aa0acebe6a38412b90bc7e88a57d3b13, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.399541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d98ed0-db84-4fa2-a927-623e758bfcf4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.400069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3671b-087a-4e65-b442-237cb07535f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.400655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3671b-087a-4e65-b442-237cb07535f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.400934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3671b-087a-4e65-b442-237cb07535f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.401231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3671b-087a-4e65-b442-237cb07535f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.402039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3671b-087a-4e65-b442-237cb07535f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.404240 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3671b-087a-4e65-b442-237cb07535f9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.409865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1326/2675] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:05 2022] PUT /identity/v3/projects/ddac56f4d6f04b488884b3d561b8c03c/users/aa0acebe6a38412b90bc7e88a57d3b13/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:05.420844 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6a40-fe12-4661-afdd-c182c49b69c7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.421245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6a40-fe12-4661-afdd-c182c49b69c7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.421556 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6a40-fe12-4661-afdd-c182c49b69c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.433646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1350/2676] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:05 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:05.437552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3671b-087a-4e65-b442-237cb07535f9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.451661 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d69c6a40-fe12-4661-afdd-c182c49b69c7 None None] MFA Rules not processed for user `aa0acebe6a38412b90bc7e88a57d3b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:05.453061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d69c6a40-fe12-4661-afdd-c182c49b69c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:05.499578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3671b-087a-4e65-b442-237cb07535f9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.504238 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b821e-5d9f-4845-b56d-6cf5a7e86e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.504990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b821e-5d9f-4845-b56d-6cf5a7e86e65 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.505328 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b821e-5d9f-4845-b56d-6cf5a7e86e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.505585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b821e-5d9f-4845-b56d-6cf5a7e86e65 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.506206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b821e-5d9f-4845-b56d-6cf5a7e86e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.508087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b821e-5d9f-4845-b56d-6cf5a7e86e65 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.521440 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1327/2677] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:05.530833 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1351/2678] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:05 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:05.534299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c6a40-fe12-4661-afdd-c182c49b69c7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.534442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b821e-5d9f-4845-b56d-6cf5a7e86e65 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.535793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d69c6a40-fe12-4661-afdd-c182c49b69c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:05.544173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b821e-5d9f-4845-b56d-6cf5a7e86e65 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.548744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f053bd-69d2-431c-b38b-6b8fa275e68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.549359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f053bd-69d2-431c-b38b-6b8fa275e68e admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.549641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f053bd-69d2-431c-b38b-6b8fa275e68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.549945 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f053bd-69d2-431c-b38b-6b8fa275e68e admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.550566 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f053bd-69d2-431c-b38b-6b8fa275e68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.552740 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f053bd-69d2-431c-b38b-6b8fa275e68e admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.562818 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1352/2679] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:05.566564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f053bd-69d2-431c-b38b-6b8fa275e68e admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.576144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f053bd-69d2-431c-b38b-6b8fa275e68e admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.581362 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ceb02-2064-43ba-9d1c-b24e0e1f3757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.581990 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ceb02-2064-43ba-9d1c-b24e0e1f3757 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.582269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ceb02-2064-43ba-9d1c-b24e0e1f3757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.583183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ceb02-2064-43ba-9d1c-b24e0e1f3757 admin admin] PATH_INFO: `/v3/projects/c649331b48394929b9bea3cb1b152fc7/users/ab6164fd53344209b66f98e498380ad1/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.592650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c6a40-fe12-4661-afdd-c182c49b69c7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.596309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59d832-eba9-45e8-a5fa-5903d910a983 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.596912 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59d832-eba9-45e8-a5fa-5903d910a983 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.597224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59d832-eba9-45e8-a5fa-5903d910a983 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.597497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59d832-eba9-45e8-a5fa-5903d910a983 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.597943 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ceb02-2064-43ba-9d1c-b24e0e1f3757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c649331b48394929b9bea3cb1b152fc7, user_id=ab6164fd53344209b66f98e498380ad1, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.600901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ceb02-2064-43ba-9d1c-b24e0e1f3757 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.607566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59d832-eba9-45e8-a5fa-5903d910a983 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.609132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59d832-eba9-45e8-a5fa-5903d910a983 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.614937 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1353/2680] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:05 2022] PUT /identity/v3/projects/c649331b48394929b9bea3cb1b152fc7/users/ab6164fd53344209b66f98e498380ad1/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:05.618857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ceb02-2064-43ba-9d1c-b24e0e1f3757 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.620566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1328/2681] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:05.668653 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:05.687908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ceb02-2064-43ba-9d1c-b24e0e1f3757 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.692594 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593d2f3-4d18-462b-9248-d644c85436c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.693226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593d2f3-4d18-462b-9248-d644c85436c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.693506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593d2f3-4d18-462b-9248-d644c85436c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.693778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593d2f3-4d18-462b-9248-d644c85436c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.694415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593d2f3-4d18-462b-9248-d644c85436c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.695970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593d2f3-4d18-462b-9248-d644c85436c9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.709097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1354/2682] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:05.710225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59d832-eba9-45e8-a5fa-5903d910a983 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.721459 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59d832-eba9-45e8-a5fa-5903d910a983 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:05.726810 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3de46-caa0-4c9e-87be-0e9b7727ffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:05.727450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3de46-caa0-4c9e-87be-0e9b7727ffc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.727730 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3de46-caa0-4c9e-87be-0e9b7727ffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.728003 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3de46-caa0-4c9e-87be-0e9b7727ffc4 admin admin] PATH_INFO: `/v3/projects/c649331b48394929b9bea3cb1b152fc7/users/ab6164fd53344209b66f98e498380ad1/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.730559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3de46-caa0-4c9e-87be-0e9b7727ffc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c649331b48394929b9bea3cb1b152fc7, user_id=ab6164fd53344209b66f98e498380ad1, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:05.733544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3de46-caa0-4c9e-87be-0e9b7727ffc4 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:05.747349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1329/2683] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:05 2022] PUT /identity/v3/projects/c649331b48394929b9bea3cb1b152fc7/users/ab6164fd53344209b66f98e498380ad1/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:05.818749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5926ef-f6ab-448c-97ad-08d6671bd8e9 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:05.819074 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5926ef-f6ab-448c-97ad-08d6671bd8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:05.819380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5926ef-f6ab-448c-97ad-08d6671bd8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:05.848955 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ca5926ef-f6ab-448c-97ad-08d6671bd8e9 None None] MFA Rules not processed for user `ab6164fd53344209b66f98e498380ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:05.850231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ca5926ef-f6ab-448c-97ad-08d6671bd8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:05.926597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1355/2684] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:05.937762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3de46-caa0-4c9e-87be-0e9b7727ffc4 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.964098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5926ef-f6ab-448c-97ad-08d6671bd8e9 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:05.973479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:05.998322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3de46-caa0-4c9e-87be-0e9b7727ffc4 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:06.001917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673eb18e-41ec-4be5-a821-fc5591d374ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:06.002514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673eb18e-41ec-4be5-a821-fc5591d374ea service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:06.002789 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673eb18e-41ec-4be5-a821-fc5591d374ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:06.003060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673eb18e-41ec-4be5-a821-fc5591d374ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:06.040241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5926ef-f6ab-448c-97ad-08d6671bd8e9 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:06.044978 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c97189-ec3b-4821-8260-832dedd355e3 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0acebe6a38412b90bc7e88a57d3b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddac56f4d6f04b488884b3d561b8c03c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:06.045578 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c97189-ec3b-4821-8260-832dedd355e3 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:06.045863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c97189-ec3b-4821-8260-832dedd355e3 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:06.046138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c97189-ec3b-4821-8260-832dedd355e3 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:06.046785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c97189-ec3b-4821-8260-832dedd355e3 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:43:06.047092 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c97189-ec3b-4821-8260-832dedd355e3 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:06.048680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c97189-ec3b-4821-8260-832dedd355e3 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:06.061198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1356/2685] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:43:06.065252 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c97189-ec3b-4821-8260-832dedd355e3 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:06.068104 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673eb18e-41ec-4be5-a821-fc5591d374ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:06.069636 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673eb18e-41ec-4be5-a821-fc5591d374ea service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:06.075205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c97189-ec3b-4821-8260-832dedd355e3 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:06.078442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1330/2686] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:06.079857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd56d-e078-40c5-813a-bdc9b1ba7532 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0acebe6a38412b90bc7e88a57d3b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddac56f4d6f04b488884b3d561b8c03c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:06.080447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd56d-e078-40c5-813a-bdc9b1ba7532 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:06.080732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd56d-e078-40c5-813a-bdc9b1ba7532 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:06.081038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd56d-e078-40c5-813a-bdc9b1ba7532 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:06.081658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcd56d-e078-40c5-813a-bdc9b1ba7532 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:06.083601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcd56d-e078-40c5-813a-bdc9b1ba7532 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:06.110445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1357/2687] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:06 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:06.115176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673eb18e-41ec-4be5-a821-fc5591d374ea service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:06.127295 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673eb18e-41ec-4be5-a821-fc5591d374ea service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:06.185092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e9439-ba9c-4f65-9fb5-c04d698eaee5 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0acebe6a38412b90bc7e88a57d3b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddac56f4d6f04b488884b3d561b8c03c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:06.185749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e9439-ba9c-4f65-9fb5-c04d698eaee5 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:06.186004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e9439-ba9c-4f65-9fb5-c04d698eaee5 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:06.186277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e9439-ba9c-4f65-9fb5-c04d698eaee5 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:06.186940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e9439-ba9c-4f65-9fb5-c04d698eaee5 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:43:06.187245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e9439-ba9c-4f65-9fb5-c04d698eaee5 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:06.188824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e9439-ba9c-4f65-9fb5-c04d698eaee5 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:06.204424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1331/2688] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:43:06.242447 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd56d-e078-40c5-813a-bdc9b1ba7532 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:06.253927 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd56d-e078-40c5-813a-bdc9b1ba7532 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:06.259401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0acebe6a38412b90bc7e88a57d3b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddac56f4d6f04b488884b3d561b8c03c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:06.260293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:06.260540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:06.260865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] PATH_INFO: `/v3/projects/02dad35a9a9e4725ae0fd6aeeb145c09` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:06.262210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: Authorizing `identity:delete_project(project_id=02dad35a9a9e4725ae0fd6aeeb145c09)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:06.264324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:06.300229 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:06.316276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02dad35a9a9e4725ae0fd6aeeb145c09', 'request_id': 'req-7b304da3-f17f-4617-a3b5-624ce0054b92'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:06.326486 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02dad35a9a9e4725ae0fd6aeeb145c09', 'request_id': 'req-7b304da3-f17f-4617-a3b5-624ce0054b92'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:06.333932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02dad35a9a9e4725ae0fd6aeeb145c09', 'request_id': 'req-7b304da3-f17f-4617-a3b5-624ce0054b92'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:06.358544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] The token cache is being invalidate because project 02dad35a9a9e4725ae0fd6aeeb145c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:06.358902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:06.359782 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-7b304da3-f17f-4617-a3b5-624ce0054b92 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:06.365855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1358/2689] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:06 2022] DELETE /identity/v3/projects/02dad35a9a9e4725ae0fd6aeeb145c09 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:06.561537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e9439-ba9c-4f65-9fb5-c04d698eaee5 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:06.563239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b39e9439-ba9c-4f65-9fb5-c04d698eaee5 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:06.628910 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e9439-ba9c-4f65-9fb5-c04d698eaee5 tempest-VolumeQuotaClassesTest-1289128918 tempest-VolumeQuotaClassesTest-1289128918-project-admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:06.656393 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:06.687134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:06.687765 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:06.688047 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:06.688322 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] PATH_INFO: `/v3/users/5ed0989e9e5445518afe77d89c03d7e9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:06.689479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed0989e9e5445518afe77d89c03d7e9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:06.691408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:06.736142 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed0989e9e5445518afe77d89c03d7e9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:06.743853 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed0989e9e5445518afe77d89c03d7e9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:06.744454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed0989e9e5445518afe77d89c03d7e9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:06.751259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed0989e9e5445518afe77d89c03d7e9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:06.763046 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed0989e9e5445518afe77d89c03d7e9'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:06.768725 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1332/2690] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:06 2022] DELETE /identity/v3/users/5ed0989e9e5445518afe77d89c03d7e9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:06.773735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b2fea-7af0-4e7d-b57e-6d83ef56da37 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:06.774016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b2fea-7af0-4e7d-b57e-6d83ef56da37 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:06.774286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b2fea-7af0-4e7d-b57e-6d83ef56da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:06.793317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-971b2fea-7af0-4e7d-b57e-6d83ef56da37 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:06.794503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-971b2fea-7af0-4e7d-b57e-6d83ef56da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:06.852555 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1359/2691] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:06.862092 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:06.864041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:06.921884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faf9df-556b-4238-b868-db14d61d8321 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:06.925438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b15db-c14b-48d9-bbd7-d1eb396e2c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:06.927050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b15db-c14b-48d9-bbd7-d1eb396e2c9c service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:06.927332 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b15db-c14b-48d9-bbd7-d1eb396e2c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:06.927718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b15db-c14b-48d9-bbd7-d1eb396e2c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:06.937045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b15db-c14b-48d9-bbd7-d1eb396e2c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:06.938492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b15db-c14b-48d9-bbd7-d1eb396e2c9c service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:06.949631 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1333/2692] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:07.223490 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b2fea-7af0-4e7d-b57e-6d83ef56da37 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:07.225028 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-971b2fea-7af0-4e7d-b57e-6d83ef56da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:07.239466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b2fea-7af0-4e7d-b57e-6d83ef56da37 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:07.244533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:07.245488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:07.245641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:07.246000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] PATH_INFO: `/v3/projects/f1940ec13ddf4255beb800c082bd31ea` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:07.247099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1940ec13ddf4255beb800c082bd31ea)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:07.248872 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:07.294951 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1940ec13ddf4255beb800c082bd31ea', 'request_id': 'req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.301567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1940ec13ddf4255beb800c082bd31ea', 'request_id': 'req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.307216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1940ec13ddf4255beb800c082bd31ea', 'request_id': 'req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.319243 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] The token cache is being invalidate because project f1940ec13ddf4255beb800c082bd31ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:07.319526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.320142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.321635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1360/2693] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:07 2022] DELETE /identity/v3/projects/f1940ec13ddf4255beb800c082bd31ea => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:07.325784 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b15db-c14b-48d9-bbd7-d1eb396e2c9c service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:07.335974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b15db-c14b-48d9-bbd7-d1eb396e2c9c service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:07.384434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:07.401518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:07.402258 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:07.402941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:07.402941 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] PATH_INFO: `/v3/users/aa0acebe6a38412b90bc7e88a57d3b13` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:07.403972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0acebe6a38412b90bc7e88a57d3b13)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:07.405931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:07.455007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0acebe6a38412b90bc7e88a57d3b13'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.463603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0acebe6a38412b90bc7e88a57d3b13'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.464297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0acebe6a38412b90bc7e88a57d3b13'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.472000 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0acebe6a38412b90bc7e88a57d3b13'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.484614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0acebe6a38412b90bc7e88a57d3b13'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.490819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1334/2694] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:07 2022] DELETE /identity/v3/users/aa0acebe6a38412b90bc7e88a57d3b13 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:07.612692 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:07.614222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:07.661995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:07.674854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6b3a6-e6a2-4c49-af53-5de7a38e1cb3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:07.724586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b4446-dbb0-4c1d-9d15-49eefae409f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:07.725214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4446-dbb0-4c1d-9d15-49eefae409f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:07.725780 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4446-dbb0-4c1d-9d15-49eefae409f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:07.726078 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b4446-dbb0-4c1d-9d15-49eefae409f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:07.727864 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-264b4446-dbb0-4c1d-9d15-49eefae409f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:07.774028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:07.775908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:07.789822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b4446-dbb0-4c1d-9d15-49eefae409f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:07.791255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b4446-dbb0-4c1d-9d15-49eefae409f6 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:07.802032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1361/2695] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:07.844991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2584b7-2835-4196-a1d2-a93ca447b426 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:07.849787 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:07.850809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:07.851097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:07.851369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] PATH_INFO: `/v3/projects/ddac56f4d6f04b488884b3d561b8c03c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:07.852479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddac56f4d6f04b488884b3d561b8c03c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:07.854495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:07.904370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddac56f4d6f04b488884b3d561b8c03c', 'request_id': 'req-1df9ab1e-37af-478f-9f0e-506b7ac3d925'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.911923 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddac56f4d6f04b488884b3d561b8c03c', 'request_id': 'req-1df9ab1e-37af-478f-9f0e-506b7ac3d925'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.918027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddac56f4d6f04b488884b3d561b8c03c', 'request_id': 'req-1df9ab1e-37af-478f-9f0e-506b7ac3d925'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.928263 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:07.932287 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] The token cache is being invalidate because project ddac56f4d6f04b488884b3d561b8c03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:07.932733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.933916 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-1df9ab1e-37af-478f-9f0e-506b7ac3d925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:07.939141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1335/2696] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:07 2022] DELETE /identity/v3/projects/ddac56f4d6f04b488884b3d561b8c03c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:07.941007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d705d-5306-4aa5-a928-983a70d00c6a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:07.941298 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d705d-5306-4aa5-a928-983a70d00c6a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:07.941569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d705d-5306-4aa5-a928-983a70d00c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:07.963048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-ba8d705d-5306-4aa5-a928-983a70d00c6a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:07.964250 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-ba8d705d-5306-4aa5-a928-983a70d00c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:08.027325 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1362/2697] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:08.036119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88a03-8801-488e-a288-e8501bf41aae None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.036440 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88a03-8801-488e-a288-e8501bf41aae None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.036662 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88a03-8801-488e-a288-e8501bf41aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.058688 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-abd88a03-8801-488e-a288-e8501bf41aae None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:08.059943 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-abd88a03-8801-488e-a288-e8501bf41aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:08.069168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1336/2698] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:08.073428 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d705d-5306-4aa5-a928-983a70d00c6a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.083744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d705d-5306-4aa5-a928-983a70d00c6a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.089001 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cf104-2f73-4528-ae0a-dc2835dd5e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.089622 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf104-2f73-4528-ae0a-dc2835dd5e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.089883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf104-2f73-4528-ae0a-dc2835dd5e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.090147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cf104-2f73-4528-ae0a-dc2835dd5e11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.090781 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cf104-2f73-4528-ae0a-dc2835dd5e11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:43:08.091079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cf104-2f73-4528-ae0a-dc2835dd5e11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.092790 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cf104-2f73-4528-ae0a-dc2835dd5e11 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.110130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1363/2699] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:43:08.111306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd88a03-8801-488e-a288-e8501bf41aae None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.121674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd88a03-8801-488e-a288-e8501bf41aae None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.127424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fe7a4-1e27-4ce4-ab18-1a86153cb825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.128021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe7a4-1e27-4ce4-ab18-1a86153cb825 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.128302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe7a4-1e27-4ce4-ab18-1a86153cb825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.129134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe7a4-1e27-4ce4-ab18-1a86153cb825 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.129770 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fe7a4-1e27-4ce4-ab18-1a86153cb825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.131692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fe7a4-1e27-4ce4-ab18-1a86153cb825 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.164980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1337/2700] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:08 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:08.167081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cf104-2f73-4528-ae0a-dc2835dd5e11 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.177834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cf104-2f73-4528-ae0a-dc2835dd5e11 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.218306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=100 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:08.238464 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5f0c5-0ff6-4da4-8d87-70eb026ecd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.239072 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5f0c5-0ff6-4da4-8d87-70eb026ecd53 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.239350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5f0c5-0ff6-4da4-8d87-70eb026ecd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.239672 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5f0c5-0ff6-4da4-8d87-70eb026ecd53 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.240324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5f0c5-0ff6-4da4-8d87-70eb026ecd53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.242233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5f0c5-0ff6-4da4-8d87-70eb026ecd53 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.267305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1364/2701] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:08 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:08.269315 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fe7a4-1e27-4ce4-ab18-1a86153cb825 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.280233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fe7a4-1e27-4ce4-ab18-1a86153cb825 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.284862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb6932-3cde-41e3-97d3-157426ccd36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.285488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6932-3cde-41e3-97d3-157426ccd36e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.285769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6932-3cde-41e3-97d3-157426ccd36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.286045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6932-3cde-41e3-97d3-157426ccd36e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.286683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb6932-3cde-41e3-97d3-157426ccd36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.288368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb6932-3cde-41e3-97d3-157426ccd36e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.301659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1338/2702] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:43:08.303087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5f0c5-0ff6-4da4-8d87-70eb026ecd53 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.313063 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5f0c5-0ff6-4da4-8d87-70eb026ecd53 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.317795 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd82b84-516a-4b3b-8d1e-c0382de6b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.318418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd82b84-516a-4b3b-8d1e-c0382de6b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.318694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd82b84-516a-4b3b-8d1e-c0382de6b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.318962 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd82b84-516a-4b3b-8d1e-c0382de6b3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.319598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd82b84-516a-4b3b-8d1e-c0382de6b3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.321189 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd82b84-516a-4b3b-8d1e-c0382de6b3a0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.331087 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1365/2703] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:43:08.335972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb6932-3cde-41e3-97d3-157426ccd36e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.346187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb6932-3cde-41e3-97d3-157426ccd36e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.351109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd82b84-516a-4b3b-8d1e-c0382de6b3a0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.351298 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3a318-617f-449c-987d-1dc9f84db9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.351951 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3a318-617f-449c-987d-1dc9f84db9cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.352225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3a318-617f-449c-987d-1dc9f84db9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.352493 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3a318-617f-449c-987d-1dc9f84db9cc admin admin] PATH_INFO: `/v3/projects/9719b5b3b60342acad4359e8cc906864/users/e6ffd3518e4c4a94967da47b0afed22b/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.352925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2cd82b84-516a-4b3b-8d1e-c0382de6b3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:08.377020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3a318-617f-449c-987d-1dc9f84db9cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9719b5b3b60342acad4359e8cc906864, user_id=e6ffd3518e4c4a94967da47b0afed22b, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.379774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3a318-617f-449c-987d-1dc9f84db9cc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.393207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1339/2704] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:08 2022] PUT /identity/v3/projects/9719b5b3b60342acad4359e8cc906864/users/e6ffd3518e4c4a94967da47b0afed22b/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:08.403928 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113f50-c9c6-4f0d-9bca-ee5e2fca2069 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.404380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113f50-c9c6-4f0d-9bca-ee5e2fca2069 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.404664 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113f50-c9c6-4f0d-9bca-ee5e2fca2069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.413337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd82b84-516a-4b3b-8d1e-c0382de6b3a0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.434341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-cf113f50-c9c6-4f0d-9bca-ee5e2fca2069 None None] MFA Rules not processed for user `e6ffd3518e4c4a94967da47b0afed22b`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:08.436396 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cf113f50-c9c6-4f0d-9bca-ee5e2fca2069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:08.468052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989dc55-1ead-478d-9aca-d12a629b3283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.468920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989dc55-1ead-478d-9aca-d12a629b3283 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.469222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989dc55-1ead-478d-9aca-d12a629b3283 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.469503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989dc55-1ead-478d-9aca-d12a629b3283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.471265 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7989dc55-1ead-478d-9aca-d12a629b3283 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:08.501546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1340/2705] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:08.506221 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113f50-c9c6-4f0d-9bca-ee5e2fca2069 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.537959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989dc55-1ead-478d-9aca-d12a629b3283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.539377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989dc55-1ead-478d-9aca-d12a629b3283 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.548848 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1366/2706] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:43:08.573615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113f50-c9c6-4f0d-9bca-ee5e2fca2069 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.578339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec1e63-09fe-404d-8a1c-3f8ffacc907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.578945 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec1e63-09fe-404d-8a1c-3f8ffacc907e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.579230 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec1e63-09fe-404d-8a1c-3f8ffacc907e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.579508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec1e63-09fe-404d-8a1c-3f8ffacc907e admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.580320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec1e63-09fe-404d-8a1c-3f8ffacc907e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.583084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec1e63-09fe-404d-8a1c-3f8ffacc907e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.613233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1341/2707] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:08 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:08.617303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989dc55-1ead-478d-9aca-d12a629b3283 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.627609 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989dc55-1ead-478d-9aca-d12a629b3283 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.654519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:08.692686 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9ce5-cfb5-4719-b9da-8990d48aeaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.693330 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9ce5-cfb5-4719-b9da-8990d48aeaca admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.693608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9ce5-cfb5-4719-b9da-8990d48aeaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.693883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9ce5-cfb5-4719-b9da-8990d48aeaca admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.694512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d9ce5-cfb5-4719-b9da-8990d48aeaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.696424 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d9ce5-cfb5-4719-b9da-8990d48aeaca admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.719281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1367/2708] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:08 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:08.723407 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec1e63-09fe-404d-8a1c-3f8ffacc907e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.735014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec1e63-09fe-404d-8a1c-3f8ffacc907e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.739888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24520-befe-4ae9-a20c-09a2d9466d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.740470 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24520-befe-4ae9-a20c-09a2d9466d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.740753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24520-befe-4ae9-a20c-09a2d9466d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.741065 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24520-befe-4ae9-a20c-09a2d9466d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.741710 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c24520-befe-4ae9-a20c-09a2d9466d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.743354 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c24520-befe-4ae9-a20c-09a2d9466d80 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.748675 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:08.756191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1342/2709] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:43:08.759165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9ce5-cfb5-4719-b9da-8990d48aeaca admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.770685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9ce5-cfb5-4719-b9da-8990d48aeaca admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.775308 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ce57f-1e65-4cc6-8466-c4f6c5302c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.775940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ce57f-1e65-4cc6-8466-c4f6c5302c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.776217 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ce57f-1e65-4cc6-8466-c4f6c5302c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.776489 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ce57f-1e65-4cc6-8466-c4f6c5302c9d admin admin] PATH_INFO: `/v3/projects/6f91909405584b638c90d86a12143039/users/8891b7bf18a54812b20ba2c556e2f100/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.791967 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ce57f-1e65-4cc6-8466-c4f6c5302c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f91909405584b638c90d86a12143039, user_id=8891b7bf18a54812b20ba2c556e2f100, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.794870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ce57f-1e65-4cc6-8466-c4f6c5302c9d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.807286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1368/2710] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:08 2022] PUT /identity/v3/projects/6f91909405584b638c90d86a12143039/users/8891b7bf18a54812b20ba2c556e2f100/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:08.811217 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24520-befe-4ae9-a20c-09a2d9466d80 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.821704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24520-befe-4ae9-a20c-09a2d9466d80 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.879486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5539c-9377-4042-8dcf-538ca277b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.880093 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5539c-9377-4042-8dcf-538ca277b397 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.880369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5539c-9377-4042-8dcf-538ca277b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.880638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5539c-9377-4042-8dcf-538ca277b397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.881305 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5539c-9377-4042-8dcf-538ca277b397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.882877 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5539c-9377-4042-8dcf-538ca277b397 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.892386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1343/2711] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:43:08.896629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ce57f-1e65-4cc6-8466-c4f6c5302c9d admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:08.906679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ce57f-1e65-4cc6-8466-c4f6c5302c9d admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:08.912138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0386e6-807c-4f3d-b9bd-7cf86a10a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:08.912776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0386e6-807c-4f3d-b9bd-7cf86a10a341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.913100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0386e6-807c-4f3d-b9bd-7cf86a10a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.913397 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0386e6-807c-4f3d-b9bd-7cf86a10a341 admin admin] PATH_INFO: `/v3/projects/6f91909405584b638c90d86a12143039/users/8891b7bf18a54812b20ba2c556e2f100/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.915272 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0386e6-807c-4f3d-b9bd-7cf86a10a341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f91909405584b638c90d86a12143039, user_id=8891b7bf18a54812b20ba2c556e2f100, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:08.917885 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0386e6-807c-4f3d-b9bd-7cf86a10a341 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:08.928203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1369/2712] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:08 2022] PUT /identity/v3/projects/6f91909405584b638c90d86a12143039/users/8891b7bf18a54812b20ba2c556e2f100/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:08.940551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13241760-1cca-4b57-b3e2-e8d9b3361929 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:08.940846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13241760-1cca-4b57-b3e2-e8d9b3361929 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:08.941204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13241760-1cca-4b57-b3e2-e8d9b3361929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:08.968077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-13241760-1cca-4b57-b3e2-e8d9b3361929 None None] MFA Rules not processed for user `8891b7bf18a54812b20ba2c556e2f100`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:08.969352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-13241760-1cca-4b57-b3e2-e8d9b3361929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:09.042121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1344/2713] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:09.052784 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0386e6-807c-4f3d-b9bd-7cf86a10a341 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:09.106654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0386e6-807c-4f3d-b9bd-7cf86a10a341 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:09.110333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a753a75-613d-4218-96cb-0278ba6c5c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:09.110915 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a753a75-613d-4218-96cb-0278ba6c5c4c service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:09.111190 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a753a75-613d-4218-96cb-0278ba6c5c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:09.111458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a753a75-613d-4218-96cb-0278ba6c5c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:09.120156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a753a75-613d-4218-96cb-0278ba6c5c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:09.121585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a753a75-613d-4218-96cb-0278ba6c5c4c service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:09.130688 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1370/2714] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:09.233998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13241760-1cca-4b57-b3e2-e8d9b3361929 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:09.243992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13241760-1cca-4b57-b3e2-e8d9b3361929 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:09.247580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20af70a-baa8-4cc6-8c59-df784a57eea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:09.248180 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af70a-baa8-4cc6-8c59-df784a57eea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:09.248462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af70a-baa8-4cc6-8c59-df784a57eea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:09.248736 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af70a-baa8-4cc6-8c59-df784a57eea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:09.304673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20af70a-baa8-4cc6-8c59-df784a57eea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:09.306937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20af70a-baa8-4cc6-8c59-df784a57eea2 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:09.318085 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1345/2715] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:11.901930 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a753a75-613d-4218-96cb-0278ba6c5c4c service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:11.962110 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a753a75-613d-4218-96cb-0278ba6c5c4c service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:11.966552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:11.967168 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:11.967450 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:11.967718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] PATH_INFO: `/v3/users/e6ffd3518e4c4a94967da47b0afed22b` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:11.968829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ffd3518e4c4a94967da47b0afed22b)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:11.970729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:11.991558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:12.017689 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ffd3518e4c4a94967da47b0afed22b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.018897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ffd3518e4c4a94967da47b0afed22b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.025785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ffd3518e4c4a94967da47b0afed22b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.037473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ffd3518e4c4a94967da47b0afed22b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.038236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ffd3518e4c4a94967da47b0afed22b'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.051569 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1371/2716] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:11 2022] DELETE /identity/v3/users/e6ffd3518e4c4a94967da47b0afed22b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:12.056027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d10dda-9455-4922-b60b-7270f9cd0802 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:12.056521 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d10dda-9455-4922-b60b-7270f9cd0802 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:12.056657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d10dda-9455-4922-b60b-7270f9cd0802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:12.075762 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-60d10dda-9455-4922-b60b-7270f9cd0802 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:12.077015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-60d10dda-9455-4922-b60b-7270f9cd0802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:12.089764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:12.135925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1346/2717] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:12.147247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:12.148676 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:12.204735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91509f-7e40-4e61-8a0b-70df88c1eb56 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:12.208755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d33ea0-5dce-4350-827b-0f632d58599d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:12.209378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33ea0-5dce-4350-827b-0f632d58599d service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:12.209655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33ea0-5dce-4350-827b-0f632d58599d service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:12.209925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33ea0-5dce-4350-827b-0f632d58599d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:12.218727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d33ea0-5dce-4350-827b-0f632d58599d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:12.220118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d33ea0-5dce-4350-827b-0f632d58599d service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:12.230170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1372/2718] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:12.448112 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d10dda-9455-4922-b60b-7270f9cd0802 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:12.449690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-60d10dda-9455-4922-b60b-7270f9cd0802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:12.462095 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d10dda-9455-4922-b60b-7270f9cd0802 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:12.466672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:12.467291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:12.467569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:12.467843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] PATH_INFO: `/v3/users/a8bdf5cf387c4938b300fcf67d1d43f7` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:12.468991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8bdf5cf387c4938b300fcf67d1d43f7)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:12.471369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:12.520225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8bdf5cf387c4938b300fcf67d1d43f7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.528639 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8bdf5cf387c4938b300fcf67d1d43f7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.529408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8bdf5cf387c4938b300fcf67d1d43f7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.537996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8bdf5cf387c4938b300fcf67d1d43f7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.551646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8bdf5cf387c4938b300fcf67d1d43f7'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.558294 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1347/2719] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:12 2022] DELETE /identity/v3/users/a8bdf5cf387c4938b300fcf67d1d43f7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:12.563248 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74b1c3-3e6b-4b27-aca0-49d03d601b32 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:12.563641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74b1c3-3e6b-4b27-aca0-49d03d601b32 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:12.563986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74b1c3-3e6b-4b27-aca0-49d03d601b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:12.584301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-9b74b1c3-3e6b-4b27-aca0-49d03d601b32 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:12.585562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9b74b1c3-3e6b-4b27-aca0-49d03d601b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:12.648547 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1373/2720] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:12.659209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:12.660702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:12.724988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885abdf-14c0-4ce3-b916-5980a12d335a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:12.730210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df413ac-db0a-4ba3-a9f5-47700c7515c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:12.730864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df413ac-db0a-4ba3-a9f5-47700c7515c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:12.731275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df413ac-db0a-4ba3-a9f5-47700c7515c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:12.731558 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df413ac-db0a-4ba3-a9f5-47700c7515c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:12.744783 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df413ac-db0a-4ba3-a9f5-47700c7515c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:12.746728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df413ac-db0a-4ba3-a9f5-47700c7515c7 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:12.757970 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74b1c3-3e6b-4b27-aca0-49d03d601b32 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:12.758457 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1348/2721] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:12.759535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-9b74b1c3-3e6b-4b27-aca0-49d03d601b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:12.774230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74b1c3-3e6b-4b27-aca0-49d03d601b32 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:12.779579 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:12.779973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:12.780327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:12.780673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] PATH_INFO: `/v3/projects/9719b5b3b60342acad4359e8cc906864` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:12.782067 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9719b5b3b60342acad4359e8cc906864)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:12.784350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:12.826684 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:12.838830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9719b5b3b60342acad4359e8cc906864', 'request_id': 'req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.845559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9719b5b3b60342acad4359e8cc906864', 'request_id': 'req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.851804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9719b5b3b60342acad4359e8cc906864', 'request_id': 'req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.865685 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] The token cache is being invalidate because project 9719b5b3b60342acad4359e8cc906864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:12.865952 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.866602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:12.868165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1374/2722] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:12 2022] DELETE /identity/v3/projects/9719b5b3b60342acad4359e8cc906864 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:12.872138 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df413ac-db0a-4ba3-a9f5-47700c7515c7 service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:12.882904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df413ac-db0a-4ba3-a9f5-47700c7515c7 service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:12.920452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:12.950488 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:12.951123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:12.951479 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:12.951678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] PATH_INFO: `/v3/users/8891b7bf18a54812b20ba2c556e2f100` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:12.952842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8891b7bf18a54812b20ba2c556e2f100)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:12.954779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.003847 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8891b7bf18a54812b20ba2c556e2f100'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.011666 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8891b7bf18a54812b20ba2c556e2f100'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.012291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8891b7bf18a54812b20ba2c556e2f100'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.020029 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8891b7bf18a54812b20ba2c556e2f100'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.033054 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8891b7bf18a54812b20ba2c556e2f100'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.040976 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1349/2723] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:12 2022] DELETE /identity/v3/users/8891b7bf18a54812b20ba2c556e2f100 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:13.048226 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.050347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:13.063532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc5b73-75a8-4b1c-aa4a-aec7dfc12a1a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.132340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.133014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.133280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.133552 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] PATH_INFO: `/v3/projects/8a7d4c47ccd34baa8eeedfb8d792d218` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.134950 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a7d4c47ccd34baa8eeedfb8d792d218)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:13.137728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.190200 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7d4c47ccd34baa8eeedfb8d792d218', 'request_id': 'req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.196343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7d4c47ccd34baa8eeedfb8d792d218', 'request_id': 'req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.202363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7d4c47ccd34baa8eeedfb8d792d218', 'request_id': 'req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.220096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] The token cache is being invalidate because project 8a7d4c47ccd34baa8eeedfb8d792d218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:13.220394 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.221590 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.223088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1375/2724] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:13 2022] DELETE /identity/v3/projects/8a7d4c47ccd34baa8eeedfb8d792d218 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:13.227360 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.228868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:13.242037 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d98c3-08ea-4a0e-891f-6d20909d52ea admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.300651 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.301303 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.301581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.301876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] PATH_INFO: `/v3/users/9d2dffee8b1d4209acec8e667d7b67fc` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.302992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2dffee8b1d4209acec8e667d7b67fc)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:13.304953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.341396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.343164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:13.358349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcf13e-7ea3-4c80-8045-9712a96ef2a9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.359019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2dffee8b1d4209acec8e667d7b67fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.367581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.367935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.368213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.368506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] PATH_INFO: `/v3/projects/6f91909405584b638c90d86a12143039` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.371475 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f91909405584b638c90d86a12143039)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:13.371632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2dffee8b1d4209acec8e667d7b67fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.372327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2dffee8b1d4209acec8e667d7b67fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.373718 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.375404 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:13.385273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2dffee8b1d4209acec8e667d7b67fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.402489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-77084d59-b55f-44d9-a87e-ebab7aca9fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2dffee8b1d4209acec8e667d7b67fc'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.410822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1350/2725] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:13 2022] DELETE /identity/v3/users/9d2dffee8b1d4209acec8e667d7b67fc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:13.428683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f91909405584b638c90d86a12143039', 'request_id': 'req-f19f639d-fe42-46b0-ab84-70a54746542a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.430038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:13.437212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f91909405584b638c90d86a12143039', 'request_id': 'req-f19f639d-fe42-46b0-ab84-70a54746542a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.444995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f91909405584b638c90d86a12143039', 'request_id': 'req-f19f639d-fe42-46b0-ab84-70a54746542a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.457856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] The token cache is being invalidate because project 6f91909405584b638c90d86a12143039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:13.458399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.458766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f19f639d-fe42-46b0-ab84-70a54746542a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.460498 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1376/2726] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:13 2022] DELETE /identity/v3/projects/6f91909405584b638c90d86a12143039 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:13.465602 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d24c6-ab45-4feb-b8f3-47e799f7013c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.465965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d24c6-ab45-4feb-b8f3-47e799f7013c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.466251 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d24c6-ab45-4feb-b8f3-47e799f7013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.487604 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9a6d24c6-ab45-4feb-b8f3-47e799f7013c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:13.489103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9a6d24c6-ab45-4feb-b8f3-47e799f7013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:13.549987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1351/2727] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:13.558083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8017b-7ddc-45ca-8858-410924f74574 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.558581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8017b-7ddc-45ca-8858-410924f74574 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.559032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8017b-7ddc-45ca-8858-410924f74574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.581331 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-bfe8017b-7ddc-45ca-8858-410924f74574 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:13.582533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-bfe8017b-7ddc-45ca-8858-410924f74574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:13.590889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1377/2728] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:13.595546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d24c6-ab45-4feb-b8f3-47e799f7013c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.605408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d24c6-ab45-4feb-b8f3-47e799f7013c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.610156 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77112f-5c9e-49fa-93ba-fd4a415d4db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.610758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77112f-5c9e-49fa-93ba-fd4a415d4db5 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.611565 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77112f-5c9e-49fa-93ba-fd4a415d4db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.611837 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77112f-5c9e-49fa-93ba-fd4a415d4db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.612514 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77112f-5c9e-49fa-93ba-fd4a415d4db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:43:13.612811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77112f-5c9e-49fa-93ba-fd4a415d4db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:13.614448 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77112f-5c9e-49fa-93ba-fd4a415d4db5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.627938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1352/2729] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:43:13.632240 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8017b-7ddc-45ca-8858-410924f74574 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.641878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8017b-7ddc-45ca-8858-410924f74574 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.647126 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309b4e6-e07a-4a98-aac7-a37196fe0461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.647747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309b4e6-e07a-4a98-aac7-a37196fe0461 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.648024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309b4e6-e07a-4a98-aac7-a37196fe0461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.648406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309b4e6-e07a-4a98-aac7-a37196fe0461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.649076 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309b4e6-e07a-4a98-aac7-a37196fe0461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:13.650944 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309b4e6-e07a-4a98-aac7-a37196fe0461 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.678122 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1378/2730] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:13 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:13.682203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77112f-5c9e-49fa-93ba-fd4a415d4db5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.692451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309b4e6-e07a-4a98-aac7-a37196fe0461 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.693063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77112f-5c9e-49fa-93ba-fd4a415d4db5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.694358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5309b4e6-e07a-4a98-aac7-a37196fe0461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:13.754162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fd8ab-9f4c-4bf2-893b-f532b8e2739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.754863 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd8ab-9f4c-4bf2-893b-f532b8e2739e admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.755213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd8ab-9f4c-4bf2-893b-f532b8e2739e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.755552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd8ab-9f4c-4bf2-893b-f532b8e2739e admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.756256 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fd8ab-9f4c-4bf2-893b-f532b8e2739e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:13.758293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fd8ab-9f4c-4bf2-893b-f532b8e2739e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.763302 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309b4e6-e07a-4a98-aac7-a37196fe0461 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.769258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.769898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.770269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.770531 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] PATH_INFO: `/v3/projects/3c30862cb96d4314be6d3420ee8249f5` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.771620 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c30862cb96d4314be6d3420ee8249f5)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:13.773571 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.781605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1353/2731] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:13 2022] POST /identity/v3/users => generated 305 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:13.786201 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fd8ab-9f4c-4bf2-893b-f532b8e2739e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.796020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fd8ab-9f4c-4bf2-893b-f532b8e2739e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.800719 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba5fa3-1df8-4c71-a690-7c4a208ed3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.801313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba5fa3-1df8-4c71-a690-7c4a208ed3bb admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.801596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba5fa3-1df8-4c71-a690-7c4a208ed3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.801869 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba5fa3-1df8-4c71-a690-7c4a208ed3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.802531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba5fa3-1df8-4c71-a690-7c4a208ed3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:13.804095 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba5fa3-1df8-4c71-a690-7c4a208ed3bb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.825851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c30862cb96d4314be6d3420ee8249f5', 'request_id': 'req-22822f87-950e-46f0-8418-e3ff02d83fe2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.833710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c30862cb96d4314be6d3420ee8249f5', 'request_id': 'req-22822f87-950e-46f0-8418-e3ff02d83fe2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.840242 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c30862cb96d4314be6d3420ee8249f5', 'request_id': 'req-22822f87-950e-46f0-8418-e3ff02d83fe2'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.855786 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] The token cache is being invalidate because project 3c30862cb96d4314be6d3420ee8249f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:13.856090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.856839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.858731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1379/2732] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:13 2022] DELETE /identity/v3/projects/3c30862cb96d4314be6d3420ee8249f5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:13.862638 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.864100 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:13.910617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:13.934758 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1354/2733] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:13.935557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22822f87-950e-46f0-8418-e3ff02d83fe2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.938623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba5fa3-1df8-4c71-a690-7c4a208ed3bb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.940793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f8ba5fa3-1df8-4c71-a690-7c4a208ed3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:13.940932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.941551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.941830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.942101 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] PATH_INFO: `/v3/users/ab6164fd53344209b66f98e498380ad1` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.943223 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6164fd53344209b66f98e498380ad1)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:13.945155 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.953181 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba5fa3-1df8-4c71-a690-7c4a208ed3bb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.958388 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eb058-e37f-4c9a-89a2-87fbbc6423f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.958963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eb058-e37f-4c9a-89a2-87fbbc6423f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.959243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eb058-e37f-4c9a-89a2-87fbbc6423f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.959518 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eb058-e37f-4c9a-89a2-87fbbc6423f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:13.960145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eb058-e37f-4c9a-89a2-87fbbc6423f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:13.961748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0eb058-e37f-4c9a-89a2-87fbbc6423f1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:13.973130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1355/2734] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:13.977902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eb058-e37f-4c9a-89a2-87fbbc6423f1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:13.988683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0eb058-e37f-4c9a-89a2-87fbbc6423f1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:13.993365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c2ee8-2e1f-4bfa-af58-702a5d2d9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:13.993505 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6164fd53344209b66f98e498380ad1'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.993991 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c2ee8-2e1f-4bfa-af58-702a5d2d9f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:13.994105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6164fd53344209b66f98e498380ad1'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:13.994271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c2ee8-2e1f-4bfa-af58-702a5d2d9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:13.994543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c2ee8-2e1f-4bfa-af58-702a5d2d9f99 admin admin] PATH_INFO: `/v3/projects/25bdcacf259c4fd88ffa0632db1be948/users/64a8f06dd62a4475b3da1cdf61f86f8a/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.001116 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6164fd53344209b66f98e498380ad1'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:14.009277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c2ee8-2e1f-4bfa-af58-702a5d2d9f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bdcacf259c4fd88ffa0632db1be948, user_id=64a8f06dd62a4475b3da1cdf61f86f8a, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.011830 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c2ee8-2e1f-4bfa-af58-702a5d2d9f99 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.013897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6164fd53344209b66f98e498380ad1'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:14.014756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6164fd53344209b66f98e498380ad1'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:14.024753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1356/2735] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:13 2022] PUT /identity/v3/projects/25bdcacf259c4fd88ffa0632db1be948/users/64a8f06dd62a4475b3da1cdf61f86f8a/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:14.028512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1380/2736] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:13 2022] DELETE /identity/v3/users/ab6164fd53344209b66f98e498380ad1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:14.094001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091b50e-f61c-49e1-a75d-2883a62fd715 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.094362 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091b50e-f61c-49e1-a75d-2883a62fd715 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.094709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091b50e-f61c-49e1-a75d-2883a62fd715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.104141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:14.126296 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-2091b50e-f61c-49e1-a75d-2883a62fd715 None None] MFA Rules not processed for user `64a8f06dd62a4475b3da1cdf61f86f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:14.128045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2091b50e-f61c-49e1-a75d-2883a62fd715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:14.197422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1357/2737] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:14.201873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.203645 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:14.270303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89837a59-3d84-46e0-be77-440b49c740d7 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.274988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f29d8f-d277-453d-ac6a-02b5a5b98500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.275595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f29d8f-d277-453d-ac6a-02b5a5b98500 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.275877 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f29d8f-d277-453d-ac6a-02b5a5b98500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.276151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f29d8f-d277-453d-ac6a-02b5a5b98500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.276778 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f29d8f-d277-453d-ac6a-02b5a5b98500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.278681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f29d8f-d277-453d-ac6a-02b5a5b98500 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.307698 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1381/2738] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:14 2022] POST /identity/v3/projects => generated 409 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:14.311752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091b50e-f61c-49e1-a75d-2883a62fd715 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.324972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091b50e-f61c-49e1-a75d-2883a62fd715 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.325520 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f29d8f-d277-453d-ac6a-02b5a5b98500 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.327431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-76f29d8f-d277-453d-ac6a-02b5a5b98500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:14.386321 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:14.394698 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a70983-f685-4417-a04f-b730a537fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.395426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a70983-f685-4417-a04f-b730a537fdbc admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.395818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a70983-f685-4417-a04f-b730a537fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.396007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a70983-f685-4417-a04f-b730a537fdbc admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.396673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a70983-f685-4417-a04f-b730a537fdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.398599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a70983-f685-4417-a04f-b730a537fdbc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.406267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f29d8f-d277-453d-ac6a-02b5a5b98500 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.411205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.412022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.412304 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.412654 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] PATH_INFO: `/v3/projects/c649331b48394929b9bea3cb1b152fc7` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.415329 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c649331b48394929b9bea3cb1b152fc7)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.417235 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.419864 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1358/2739] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:14 2022] POST /identity/v3/users => generated 311 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:14.424333 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a70983-f685-4417-a04f-b730a537fdbc admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.433700 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a70983-f685-4417-a04f-b730a537fdbc admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.438351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d849-2658-46b9-b34b-2414d1c7bab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.439048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d849-2658-46b9-b34b-2414d1c7bab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.439285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d849-2658-46b9-b34b-2414d1c7bab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.439561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d849-2658-46b9-b34b-2414d1c7bab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.440189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1d849-2658-46b9-b34b-2414d1c7bab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.441786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1d849-2658-46b9-b34b-2414d1c7bab6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.452242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1359/2740] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:14.456858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d849-2658-46b9-b34b-2414d1c7bab6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.466380 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d849-2658-46b9-b34b-2414d1c7bab6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.466652 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c649331b48394929b9bea3cb1b152fc7', 'request_id': 'req-334344bc-60b5-4a9e-837d-9cd777cd8f3c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:14.472894 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c649331b48394929b9bea3cb1b152fc7', 'request_id': 'req-334344bc-60b5-4a9e-837d-9cd777cd8f3c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:14.478820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c649331b48394929b9bea3cb1b152fc7', 'request_id': 'req-334344bc-60b5-4a9e-837d-9cd777cd8f3c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:14.492046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] The token cache is being invalidate because project c649331b48394929b9bea3cb1b152fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:14.492335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:14.492996 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-334344bc-60b5-4a9e-837d-9cd777cd8f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:14.494529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1382/2741] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:14 2022] DELETE /identity/v3/projects/c649331b48394929b9bea3cb1b152fc7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:14.499144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423157-6bdc-419d-a65d-7e4bf7bb0305 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.499504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423157-6bdc-419d-a65d-7e4bf7bb0305 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.499854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423157-6bdc-419d-a65d-7e4bf7bb0305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.520596 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-85423157-6bdc-419d-a65d-7e4bf7bb0305 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:14.521827 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-85423157-6bdc-419d-a65d-7e4bf7bb0305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:14.527450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed344593-dd4d-444c-97e2-b5fd2ea16b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.528122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed344593-dd4d-444c-97e2-b5fd2ea16b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.528403 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed344593-dd4d-444c-97e2-b5fd2ea16b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.528681 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed344593-dd4d-444c-97e2-b5fd2ea16b17 admin admin] PATH_INFO: `/v3/projects/d24f7d079e3d4c28be06ffd599df994a/users/368a48758c3a40e692e60623c49f815c/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.542845 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed344593-dd4d-444c-97e2-b5fd2ea16b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24f7d079e3d4c28be06ffd599df994a, user_id=368a48758c3a40e692e60623c49f815c, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.545508 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed344593-dd4d-444c-97e2-b5fd2ea16b17 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.549442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:14.560400 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1360/2742] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:14 2022] PUT /identity/v3/projects/d24f7d079e3d4c28be06ffd599df994a/users/368a48758c3a40e692e60623c49f815c/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:14.564339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed344593-dd4d-444c-97e2-b5fd2ea16b17 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.566210 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ed344593-dd4d-444c-97e2-b5fd2ea16b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:14.582461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1383/2743] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:14.589849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1639347-e48b-4eed-a3f0-50882e72b5a0 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.590142 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1639347-e48b-4eed-a3f0-50882e72b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.590408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1639347-e48b-4eed-a3f0-50882e72b5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.609558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a1639347-e48b-4eed-a3f0-50882e72b5a0 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:14.611285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a1639347-e48b-4eed-a3f0-50882e72b5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:14.630703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed344593-dd4d-444c-97e2-b5fd2ea16b17 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.635334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143ba08-aab1-4add-9f72-21cec758e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.635933 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143ba08-aab1-4add-9f72-21cec758e6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.636211 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143ba08-aab1-4add-9f72-21cec758e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.636481 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143ba08-aab1-4add-9f72-21cec758e6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.637147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143ba08-aab1-4add-9f72-21cec758e6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.638714 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143ba08-aab1-4add-9f72-21cec758e6c9 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.648326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1361/2744] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:14.652511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143ba08-aab1-4add-9f72-21cec758e6c9 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.662657 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143ba08-aab1-4add-9f72-21cec758e6c9 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.667215 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eca698-71cd-4d71-a5f6-0ea2c3308ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.667846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eca698-71cd-4d71-a5f6-0ea2c3308ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.668122 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eca698-71cd-4d71-a5f6-0ea2c3308ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.668391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eca698-71cd-4d71-a5f6-0ea2c3308ffc admin admin] PATH_INFO: `/v3/projects/d24f7d079e3d4c28be06ffd599df994a/users/368a48758c3a40e692e60623c49f815c/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.670350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eca698-71cd-4d71-a5f6-0ea2c3308ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24f7d079e3d4c28be06ffd599df994a, user_id=368a48758c3a40e692e60623c49f815c, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.671619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1384/2745] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:14.673084 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eca698-71cd-4d71-a5f6-0ea2c3308ffc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.676332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1639347-e48b-4eed-a3f0-50882e72b5a0 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.684489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1362/2746] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:14 2022] PUT /identity/v3/projects/d24f7d079e3d4c28be06ffd599df994a/users/368a48758c3a40e692e60623c49f815c/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:14.685094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1639347-e48b-4eed-a3f0-50882e72b5a0 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.694425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad8ee3-c023-4162-ade9-c3a1b4d50c27 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.694642 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad8ee3-c023-4162-ade9-c3a1b4d50c27 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.694917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad8ee3-c023-4162-ade9-c3a1b4d50c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.696641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:14.723709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-41ad8ee3-c023-4162-ade9-c3a1b4d50c27 None None] MFA Rules not processed for user `368a48758c3a40e692e60623c49f815c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:14.725123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-41ad8ee3-c023-4162-ade9-c3a1b4d50c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:14.743779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddd71d-54cb-4a8a-8f7f-5fa4808a4b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.744381 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd71d-54cb-4a8a-8f7f-5fa4808a4b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.744656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd71d-54cb-4a8a-8f7f-5fa4808a4b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.744931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd71d-54cb-4a8a-8f7f-5fa4808a4b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.745595 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddd71d-54cb-4a8a-8f7f-5fa4808a4b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:43:14.745895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddd71d-54cb-4a8a-8f7f-5fa4808a4b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.747460 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddd71d-54cb-4a8a-8f7f-5fa4808a4b58 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.759344 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1385/2747] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:43:14.763599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddd71d-54cb-4a8a-8f7f-5fa4808a4b58 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.773857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddd71d-54cb-4a8a-8f7f-5fa4808a4b58 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.778535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9660e0-f7d7-47ad-9ba3-8fadacbbc0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.779109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9660e0-f7d7-47ad-9ba3-8fadacbbc0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.779454 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9660e0-f7d7-47ad-9ba3-8fadacbbc0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.779671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9660e0-f7d7-47ad-9ba3-8fadacbbc0c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.780281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9660e0-f7d7-47ad-9ba3-8fadacbbc0c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.782160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9660e0-f7d7-47ad-9ba3-8fadacbbc0c4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.792990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1363/2748] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:14.804351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad8ee3-c023-4162-ade9-c3a1b4d50c27 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.805756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-41ad8ee3-c023-4162-ade9-c3a1b4d50c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:14.813111 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1386/2749] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:14 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:14.814886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9660e0-f7d7-47ad-9ba3-8fadacbbc0c4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.865594 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad8ee3-c023-4162-ade9-c3a1b4d50c27 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.878234 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9660e0-f7d7-47ad-9ba3-8fadacbbc0c4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.882242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:14.883153 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69d418-e9a8-497c-a67c-ee69a7bd3eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.883722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69d418-e9a8-497c-a67c-ee69a7bd3eab admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.884000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69d418-e9a8-497c-a67c-ee69a7bd3eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.884350 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69d418-e9a8-497c-a67c-ee69a7bd3eab admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.885274 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69d418-e9a8-497c-a67c-ee69a7bd3eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.887351 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69d418-e9a8-497c-a67c-ee69a7bd3eab admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.911836 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1387/2750] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:14 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:43:14.912911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69d418-e9a8-497c-a67c-ee69a7bd3eab admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.917713 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3b025-0c62-4082-93f4-88432524e134 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.918517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3b025-0c62-4082-93f4-88432524e134 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.918804 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3b025-0c62-4082-93f4-88432524e134 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.919075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3b025-0c62-4082-93f4-88432524e134 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.922463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69d418-e9a8-497c-a67c-ee69a7bd3eab admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.927040 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31324e6-b688-44b4-b4ac-eb5cb0032248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.927620 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31324e6-b688-44b4-b4ac-eb5cb0032248 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.927898 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31324e6-b688-44b4-b4ac-eb5cb0032248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.928170 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31324e6-b688-44b4-b4ac-eb5cb0032248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.928804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31324e6-b688-44b4-b4ac-eb5cb0032248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.930385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31324e6-b688-44b4-b4ac-eb5cb0032248 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.940776 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1388/2751] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:14.944722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31324e6-b688-44b4-b4ac-eb5cb0032248 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.954756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31324e6-b688-44b4-b4ac-eb5cb0032248 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.959396 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9552734-67c1-4094-b623-c6a73b1d0758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.960022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9552734-67c1-4094-b623-c6a73b1d0758 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.960307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9552734-67c1-4094-b623-c6a73b1d0758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.960577 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9552734-67c1-4094-b623-c6a73b1d0758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:14.961222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9552734-67c1-4094-b623-c6a73b1d0758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.962804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9552734-67c1-4094-b623-c6a73b1d0758 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.974390 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1389/2752] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:14.979214 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9552734-67c1-4094-b623-c6a73b1d0758 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:14.980986 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3b025-0c62-4082-93f4-88432524e134 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:14.982426 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3b025-0c62-4082-93f4-88432524e134 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:14.988522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9552734-67c1-4094-b623-c6a73b1d0758 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:14.992134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1364/2753] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:14 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:43:14.993083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fa326-b0a3-4bdf-93a9-f00aa0fed7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:14.993713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa326-b0a3-4bdf-93a9-f00aa0fed7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:14.993995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa326-b0a3-4bdf-93a9-f00aa0fed7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:14.994273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa326-b0a3-4bdf-93a9-f00aa0fed7f2 admin admin] PATH_INFO: `/v3/projects/9eff73c6ea0846a383f50b228aeb2432/users/cf22d3aa1f254eb8ac59e777be927d4d/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:15.009246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fa326-b0a3-4bdf-93a9-f00aa0fed7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eff73c6ea0846a383f50b228aeb2432, user_id=cf22d3aa1f254eb8ac59e777be927d4d, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:15.011847 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fa326-b0a3-4bdf-93a9-f00aa0fed7f2 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:15.024969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1390/2754] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:14 2022] PUT /identity/v3/projects/9eff73c6ea0846a383f50b228aeb2432/users/cf22d3aa1f254eb8ac59e777be927d4d/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:15.030445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590203-116b-4db4-9e5d-a9381a2c514c None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:15.030740 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590203-116b-4db4-9e5d-a9381a2c514c None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:15.031015 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590203-116b-4db4-9e5d-a9381a2c514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:15.050671 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-44590203-116b-4db4-9e5d-a9381a2c514c None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:15.051878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-44590203-116b-4db4-9e5d-a9381a2c514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:15.114282 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1365/2755] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:43:15.124412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fa326-b0a3-4bdf-93a9-f00aa0fed7f2 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:15.126466 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7b8fa326-b0a3-4bdf-93a9-f00aa0fed7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:15.146447 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44590203-116b-4db4-9e5d-a9381a2c514c None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:15.162849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:15.187513 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fa326-b0a3-4bdf-93a9-f00aa0fed7f2 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:15.191884 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4b4a0-9cb5-4ad2-b939-6d3aec582ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:15.192635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b4a0-9cb5-4ad2-b939-6d3aec582ade service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:15.193108 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b4a0-9cb5-4ad2-b939-6d3aec582ade service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:15.193480 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b4a0-9cb5-4ad2-b939-6d3aec582ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:15.202162 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44590203-116b-4db4-9e5d-a9381a2c514c None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:15.202669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4b4a0-9cb5-4ad2-b939-6d3aec582ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:15.204089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4b4a0-9cb5-4ad2-b939-6d3aec582ade service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:15.206405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb747006-5869-4fe5-ac4c-b236fcbbccc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:15.207006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb747006-5869-4fe5-ac4c-b236fcbbccc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:15.207289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb747006-5869-4fe5-ac4c-b236fcbbccc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:15.207562 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb747006-5869-4fe5-ac4c-b236fcbbccc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:15.209860 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-cb747006-5869-4fe5-ac4c-b236fcbbccc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:15.214201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1391/2756] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:15.236886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=100 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:15.270960 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb747006-5869-4fe5-ac4c-b236fcbbccc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:15.272496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb747006-5869-4fe5-ac4c-b236fcbbccc9 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:15.281324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1366/2757] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:15 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:43:15.888610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a833-e953-47b1-976d-5c43a294b18b None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:15.888974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a833-e953-47b1-976d-5c43a294b18b None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:15.889203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a833-e953-47b1-976d-5c43a294b18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:15.918820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1887a833-e953-47b1-976d-5c43a294b18b None None] MFA Rules not processed for user `cf22d3aa1f254eb8ac59e777be927d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:15.920029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1887a833-e953-47b1-976d-5c43a294b18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:15.989515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1392/2758] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:16.000640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb747006-5869-4fe5-ac4c-b236fcbbccc9 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:16.009506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb747006-5869-4fe5-ac4c-b236fcbbccc9 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:16.013132 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b462-902c-404e-8d53-916c7d087f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:16.013731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b462-902c-404e-8d53-916c7d087f7f service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:16.014009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b462-902c-404e-8d53-916c7d087f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:16.014279 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b462-902c-404e-8d53-916c7d087f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:16.023659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b462-902c-404e-8d53-916c7d087f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:16.025166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b462-902c-404e-8d53-916c7d087f7f service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:16.034351 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1367/2759] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:17.397448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb9cc-2aad-4bf4-8d14-861094866a36 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:17.397903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb9cc-2aad-4bf4-8d14-861094866a36 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:17.398006 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb9cc-2aad-4bf4-8d14-861094866a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:17.418712 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-94ebb9cc-2aad-4bf4-8d14-861094866a36 None None] MFA Rules not processed for user `cf22d3aa1f254eb8ac59e777be927d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:17.419908 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-94ebb9cc-2aad-4bf4-8d14-861094866a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:17.426728 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1393/2760] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:19.799291 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b462-902c-404e-8d53-916c7d087f7f service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:19.800710 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9f60b462-902c-404e-8d53-916c7d087f7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:19.813586 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b462-902c-404e-8d53-916c7d087f7f service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:19.817421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a1417-8d06-47eb-b560-2785a09188a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:19.817982 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1417-8d06-47eb-b560-2785a09188a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:19.818260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1417-8d06-47eb-b560-2785a09188a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:19.818528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a1417-8d06-47eb-b560-2785a09188a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:19.820178 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ff7a1417-8d06-47eb-b560-2785a09188a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:19.830461 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a1417-8d06-47eb-b560-2785a09188a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:19.831909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a1417-8d06-47eb-b560-2785a09188a3 service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:19.840075 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1368/2761] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:20.643789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebb9cc-2aad-4bf4-8d14-861094866a36 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:20.655285 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebb9cc-2aad-4bf4-8d14-861094866a36 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:20.660306 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:20.660960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:20.661257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:20.661529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] PATH_INFO: `/v3/users/64a8f06dd62a4475b3da1cdf61f86f8a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:20.662658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a8f06dd62a4475b3da1cdf61f86f8a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:20.664568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:20.712604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a8f06dd62a4475b3da1cdf61f86f8a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:20.713270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a8f06dd62a4475b3da1cdf61f86f8a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:20.721183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a8f06dd62a4475b3da1cdf61f86f8a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:20.733732 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a8f06dd62a4475b3da1cdf61f86f8a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:20.734974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a8f06dd62a4475b3da1cdf61f86f8a'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:20.748562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1394/2762] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:20 2022] DELETE /identity/v3/users/64a8f06dd62a4475b3da1cdf61f86f8a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:20.753131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24c6d-ed7e-41e8-8bda-69e6f29dbf81 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:20.753465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24c6d-ed7e-41e8-8bda-69e6f29dbf81 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:20.753728 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24c6d-ed7e-41e8-8bda-69e6f29dbf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:20.772608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-bac24c6d-ed7e-41e8-8bda-69e6f29dbf81 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:20.773857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bac24c6d-ed7e-41e8-8bda-69e6f29dbf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:20.833752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1369/2763] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:20.845049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:20.846482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:20.880734 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:20.911901 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b70f4-4e69-4e76-8a0e-e0a17e5f6ccc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:20.915694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e48ec-bfb0-4695-90b7-f3ce51bef1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:20.916303 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e48ec-bfb0-4695-90b7-f3ce51bef1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:20.916605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e48ec-bfb0-4695-90b7-f3ce51bef1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:20.916855 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e48ec-bfb0-4695-90b7-f3ce51bef1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:20.926052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e48ec-bfb0-4695-90b7-f3ce51bef1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:20.927601 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e48ec-bfb0-4695-90b7-f3ce51bef1f1 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:20.937700 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1395/2764] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:21.212583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24c6d-ed7e-41e8-8bda-69e6f29dbf81 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:21.214395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-bac24c6d-ed7e-41e8-8bda-69e6f29dbf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:21.228127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24c6d-ed7e-41e8-8bda-69e6f29dbf81 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:21.232748 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:21.233409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:21.233690 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:21.233965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] PATH_INFO: `/v3/projects/25bdcacf259c4fd88ffa0632db1be948` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:21.235080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25bdcacf259c4fd88ffa0632db1be948)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:21.237155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:21.283866 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25bdcacf259c4fd88ffa0632db1be948', 'request_id': 'req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.289996 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25bdcacf259c4fd88ffa0632db1be948', 'request_id': 'req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.295590 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25bdcacf259c4fd88ffa0632db1be948', 'request_id': 'req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.307755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] The token cache is being invalidate because project 25bdcacf259c4fd88ffa0632db1be948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:21.308045 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.308687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.310173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1370/2765] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:21 2022] DELETE /identity/v3/projects/25bdcacf259c4fd88ffa0632db1be948 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:21.314293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e48ec-bfb0-4695-90b7-f3ce51bef1f1 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:21.324166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e48ec-bfb0-4695-90b7-f3ce51bef1f1 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:21.380136 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:21.380764 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:21.381083 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:21.381356 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] PATH_INFO: `/v3/users/368a48758c3a40e692e60623c49f815c` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:21.382483 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=368a48758c3a40e692e60623c49f815c)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:21.384404 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:21.429061 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368a48758c3a40e692e60623c49f815c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.429717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368a48758c3a40e692e60623c49f815c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.436452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368a48758c3a40e692e60623c49f815c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.448604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368a48758c3a40e692e60623c49f815c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.449299 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-853d386f-18ea-424a-b71f-18be265c1e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368a48758c3a40e692e60623c49f815c'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.462880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1396/2766] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:21 2022] DELETE /identity/v3/users/368a48758c3a40e692e60623c49f815c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:21.809472 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:21.810963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:21.825587 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423a616-1a22-4c3d-a7f9-6221a6a1c9e6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:21.844193 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:21.887826 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:21.888478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:21.888756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:21.889063 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] PATH_INFO: `/v3/projects/d24f7d079e3d4c28be06ffd599df994a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:21.890196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24f7d079e3d4c28be06ffd599df994a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:21.892089 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:21.937280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24f7d079e3d4c28be06ffd599df994a', 'request_id': 'req-52584596-b0b5-4152-ab07-6821203c0d6b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.943167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24f7d079e3d4c28be06ffd599df994a', 'request_id': 'req-52584596-b0b5-4152-ab07-6821203c0d6b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.948709 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24f7d079e3d4c28be06ffd599df994a', 'request_id': 'req-52584596-b0b5-4152-ab07-6821203c0d6b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.960334 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] The token cache is being invalidate because project d24f7d079e3d4c28be06ffd599df994a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:21.960618 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.961244 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-52584596-b0b5-4152-ab07-6821203c0d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:21.962668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1371/2767] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:21 2022] DELETE /identity/v3/projects/d24f7d079e3d4c28be06ffd599df994a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:21.967515 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea63a58-7ad7-4b89-912b-151a739e83e1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:21.968051 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea63a58-7ad7-4b89-912b-151a739e83e1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:21.968156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea63a58-7ad7-4b89-912b-151a739e83e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:21.988021 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8ea63a58-7ad7-4b89-912b-151a739e83e1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:21.989188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8ea63a58-7ad7-4b89-912b-151a739e83e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:22.035599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:22.051583 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1397/2768] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:22.059314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd424-f1fe-4681-a943-a82eef8edc9b None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.059599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd424-f1fe-4681-a943-a82eef8edc9b None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.059901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd424-f1fe-4681-a943-a82eef8edc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.079486 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d88cd424-f1fe-4681-a943-a82eef8edc9b None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:22.080667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d88cd424-f1fe-4681-a943-a82eef8edc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:22.088417 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1372/2769] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:22.092479 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea63a58-7ad7-4b89-912b-151a739e83e1 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.102503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea63a58-7ad7-4b89-912b-151a739e83e1 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.107049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee74858-62ec-41dd-a884-296ac902517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.107636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee74858-62ec-41dd-a884-296ac902517a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.107917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee74858-62ec-41dd-a884-296ac902517a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.108188 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee74858-62ec-41dd-a884-296ac902517a admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.109404 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee74858-62ec-41dd-a884-296ac902517a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:43:22.109707 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee74858-62ec-41dd-a884-296ac902517a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.111276 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee74858-62ec-41dd-a884-296ac902517a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.122516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1398/2770] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:43:22.127124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cd424-f1fe-4681-a943-a82eef8edc9b None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.136665 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cd424-f1fe-4681-a943-a82eef8edc9b None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.142309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0cb18-8a70-437d-b8f7-3cd18e6a5af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.143188 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0cb18-8a70-437d-b8f7-3cd18e6a5af5 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.143614 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0cb18-8a70-437d-b8f7-3cd18e6a5af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.144019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0cb18-8a70-437d-b8f7-3cd18e6a5af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.144992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0cb18-8a70-437d-b8f7-3cd18e6a5af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.148103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0cb18-8a70-437d-b8f7-3cd18e6a5af5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.184382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1373/2771] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:22 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:22.189050 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee74858-62ec-41dd-a884-296ac902517a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.198861 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee74858-62ec-41dd-a884-296ac902517a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.254041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d8ebf-d592-4980-a095-5f1d9605f901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.254564 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d8ebf-d592-4980-a095-5f1d9605f901 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.254844 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d8ebf-d592-4980-a095-5f1d9605f901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.255118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d8ebf-d592-4980-a095-5f1d9605f901 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.255744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d8ebf-d592-4980-a095-5f1d9605f901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.257681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d8ebf-d592-4980-a095-5f1d9605f901 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.278878 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1399/2772] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:22 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:22.283134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0cb18-8a70-437d-b8f7-3cd18e6a5af5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.293357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0cb18-8a70-437d-b8f7-3cd18e6a5af5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.297956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49001f5-b87b-46a0-8da8-b02e1fb55ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.298551 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49001f5-b87b-46a0-8da8-b02e1fb55ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.298832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49001f5-b87b-46a0-8da8-b02e1fb55ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.299113 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49001f5-b87b-46a0-8da8-b02e1fb55ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.299755 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49001f5-b87b-46a0-8da8-b02e1fb55ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.301373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49001f5-b87b-46a0-8da8-b02e1fb55ed1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.311014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1374/2773] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:43:22.315141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d8ebf-d592-4980-a095-5f1d9605f901 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.324748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d8ebf-d592-4980-a095-5f1d9605f901 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.330222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea35fd-9979-4919-8592-c27dd4992cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.330805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea35fd-9979-4919-8592-c27dd4992cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.331085 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea35fd-9979-4919-8592-c27dd4992cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.331359 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea35fd-9979-4919-8592-c27dd4992cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.331987 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea35fd-9979-4919-8592-c27dd4992cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.333600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea35fd-9979-4919-8592-c27dd4992cc5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.344065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1400/2774] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:43:22.348371 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49001f5-b87b-46a0-8da8-b02e1fb55ed1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.358407 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49001f5-b87b-46a0-8da8-b02e1fb55ed1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.363030 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c09e6-5e8c-420b-b122-43284320cf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.363689 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c09e6-5e8c-420b-b122-43284320cf41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.363950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c09e6-5e8c-420b-b122-43284320cf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.364223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c09e6-5e8c-420b-b122-43284320cf41 admin admin] PATH_INFO: `/v3/projects/b598c8c81c3343e0aabc66d705ab5f43/users/aab9f400426d46149c5952827c5622e3/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.379028 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c09e6-5e8c-420b-b122-43284320cf41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b598c8c81c3343e0aabc66d705ab5f43, user_id=aab9f400426d46149c5952827c5622e3, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.381653 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c09e6-5e8c-420b-b122-43284320cf41 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.394131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1375/2775] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:22 2022] PUT /identity/v3/projects/b598c8c81c3343e0aabc66d705ab5f43/users/aab9f400426d46149c5952827c5622e3/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:22.405837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab4d8d-ef24-4d1a-a4b7-60a5a2718038 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.406123 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab4d8d-ef24-4d1a-a4b7-60a5a2718038 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.406435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab4d8d-ef24-4d1a-a4b7-60a5a2718038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.434717 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-49ab4d8d-ef24-4d1a-a4b7-60a5a2718038 None None] MFA Rules not processed for user `aab9f400426d46149c5952827c5622e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:22.435926 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-49ab4d8d-ef24-4d1a-a4b7-60a5a2718038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:22.499004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1401/2776] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:22.503702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c09e6-5e8c-420b-b122-43284320cf41 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.552544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:22.568024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c09e6-5e8c-420b-b122-43284320cf41 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.572648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee56abf-a4db-4737-9c3a-ebd072f0d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.573268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56abf-a4db-4737-9c3a-ebd072f0d3ea admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.573553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56abf-a4db-4737-9c3a-ebd072f0d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.573820 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee56abf-a4db-4737-9c3a-ebd072f0d3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.574449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee56abf-a4db-4737-9c3a-ebd072f0d3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.576314 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee56abf-a4db-4737-9c3a-ebd072f0d3ea admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.603301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1376/2777] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:43:22 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:22.607590 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab4d8d-ef24-4d1a-a4b7-60a5a2718038 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.618194 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab4d8d-ef24-4d1a-a4b7-60a5a2718038 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.661756 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:22.675925 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba29d45-da6a-4ba7-90ab-51e314e31d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.676526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba29d45-da6a-4ba7-90ab-51e314e31d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.676808 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba29d45-da6a-4ba7-90ab-51e314e31d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.677097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba29d45-da6a-4ba7-90ab-51e314e31d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.677726 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba29d45-da6a-4ba7-90ab-51e314e31d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.679669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba29d45-da6a-4ba7-90ab-51e314e31d5b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.705053 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1402/2778] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:43:22 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:43:22.706205 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee56abf-a4db-4737-9c3a-ebd072f0d3ea admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.716583 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee56abf-a4db-4737-9c3a-ebd072f0d3ea admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.722198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b9ec-8a7f-4a9a-9602-3bf2596f6f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.722809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b9ec-8a7f-4a9a-9602-3bf2596f6f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.723080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b9ec-8a7f-4a9a-9602-3bf2596f6f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.723353 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b9ec-8a7f-4a9a-9602-3bf2596f6f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.723993 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350b9ec-8a7f-4a9a-9602-3bf2596f6f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.725638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350b9ec-8a7f-4a9a-9602-3bf2596f6f82 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.736410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1377/2779] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:43:22.740762 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba29d45-da6a-4ba7-90ab-51e314e31d5b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.750805 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba29d45-da6a-4ba7-90ab-51e314e31d5b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.755769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091a5bf-a82b-4ac1-838b-92f20e5a4038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.756428 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091a5bf-a82b-4ac1-838b-92f20e5a4038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.756838 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091a5bf-a82b-4ac1-838b-92f20e5a4038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.757166 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091a5bf-a82b-4ac1-838b-92f20e5a4038 admin admin] PATH_INFO: `/v3/projects/b36f1e2df709464e8bc492feff49b562/users/a88f2320072a428289e19249fc719f87/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.774258 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091a5bf-a82b-4ac1-838b-92f20e5a4038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36f1e2df709464e8bc492feff49b562, user_id=a88f2320072a428289e19249fc719f87, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.776969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091a5bf-a82b-4ac1-838b-92f20e5a4038 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.790343 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1403/2780] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:22 2022] PUT /identity/v3/projects/b36f1e2df709464e8bc492feff49b562/users/a88f2320072a428289e19249fc719f87/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:22.794494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b9ec-8a7f-4a9a-9602-3bf2596f6f82 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.804805 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b9ec-8a7f-4a9a-9602-3bf2596f6f82 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.861543 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bd17f-acf7-4c20-b9e8-a96b1399b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.862202 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bd17f-acf7-4c20-b9e8-a96b1399b1cc admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.862405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bd17f-acf7-4c20-b9e8-a96b1399b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.862673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bd17f-acf7-4c20-b9e8-a96b1399b1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.863301 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bd17f-acf7-4c20-b9e8-a96b1399b1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.864875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bd17f-acf7-4c20-b9e8-a96b1399b1cc admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.874942 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1378/2781] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:43:22.879014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091a5bf-a82b-4ac1-838b-92f20e5a4038 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:22.889173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091a5bf-a82b-4ac1-838b-92f20e5a4038 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:22.893867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed4bdc-56b6-4a30-a840-77cd4500e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:22.894510 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed4bdc-56b6-4a30-a840-77cd4500e9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.894790 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed4bdc-56b6-4a30-a840-77cd4500e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.895064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed4bdc-56b6-4a30-a840-77cd4500e9e5 admin admin] PATH_INFO: `/v3/projects/b36f1e2df709464e8bc492feff49b562/users/a88f2320072a428289e19249fc719f87/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.897064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed4bdc-56b6-4a30-a840-77cd4500e9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36f1e2df709464e8bc492feff49b562, user_id=a88f2320072a428289e19249fc719f87, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:22.899739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed4bdc-56b6-4a30-a840-77cd4500e9e5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:22.910307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1404/2782] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:43:22 2022] PUT /identity/v3/projects/b36f1e2df709464e8bc492feff49b562/users/a88f2320072a428289e19249fc719f87/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:22.920170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934d25-c0c0-45a1-a1ef-05238a0c3f6f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:22.920456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934d25-c0c0-45a1-a1ef-05238a0c3f6f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:22.921310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934d25-c0c0-45a1-a1ef-05238a0c3f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:22.947992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-13934d25-c0c0-45a1-a1ef-05238a0c3f6f None None] MFA Rules not processed for user `a88f2320072a428289e19249fc719f87`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:22.949249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-13934d25-c0c0-45a1-a1ef-05238a0c3f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:23.014632 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1379/2783] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:23.025772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed4bdc-56b6-4a30-a840-77cd4500e9e5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:23.027572 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-2fed4bdc-56b6-4a30-a840-77cd4500e9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:23.085830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed4bdc-56b6-4a30-a840-77cd4500e9e5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:23.089472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71454361-82ef-48a3-8341-81c4008579e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:23.090071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71454361-82ef-48a3-8341-81c4008579e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:23.090352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71454361-82ef-48a3-8341-81c4008579e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:23.090623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71454361-82ef-48a3-8341-81c4008579e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:23.100093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71454361-82ef-48a3-8341-81c4008579e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:23.101540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71454361-82ef-48a3-8341-81c4008579e2 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:23.111399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1405/2784] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:23.194537 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13934d25-c0c0-45a1-a1ef-05238a0c3f6f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:23.204571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13934d25-c0c0-45a1-a1ef-05238a0c3f6f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:23.208270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53909bf2-aa68-4085-ac0f-c9a2cbd436a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:23.208857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909bf2-aa68-4085-ac0f-c9a2cbd436a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:23.209163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909bf2-aa68-4085-ac0f-c9a2cbd436a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:23.209505 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909bf2-aa68-4085-ac0f-c9a2cbd436a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:23.250895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:23.266994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53909bf2-aa68-4085-ac0f-c9a2cbd436a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:23.268422 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53909bf2-aa68-4085-ac0f-c9a2cbd436a9 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:23.277489 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1380/2785] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:28.007646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71454361-82ef-48a3-8341-81c4008579e2 service cinder] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:28.070598 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71454361-82ef-48a3-8341-81c4008579e2 service cinder] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:28.075082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:28.076236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:28.076543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:28.076815 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] PATH_INFO: `/v3/users/aab9f400426d46149c5952827c5622e3` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:28.077946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab9f400426d46149c5952827c5622e3)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:28.079823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:28.124286 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:28.127191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab9f400426d46149c5952827c5622e3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.127969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab9f400426d46149c5952827c5622e3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.135832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab9f400426d46149c5952827c5622e3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.148191 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab9f400426d46149c5952827c5622e3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.148832 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab9f400426d46149c5952827c5622e3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.162096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1406/2786] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:28 2022] DELETE /identity/v3/users/aab9f400426d46149c5952827c5622e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:28.166640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e06e-cc9c-4ec5-b1f2-e5908a6511ef None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:28.167094 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e06e-cc9c-4ec5-b1f2-e5908a6511ef None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:28.167223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e06e-cc9c-4ec5-b1f2-e5908a6511ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:28.186425 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9d01e06e-cc9c-4ec5-b1f2-e5908a6511ef None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:28.187600 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9d01e06e-cc9c-4ec5-b1f2-e5908a6511ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:28.246097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1381/2787] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:28.255897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:28.257368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:28.316262 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c697-ddc6-4e96-b0f6-4d055580e494 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:28.319916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556adf4-edf2-464f-ad25-9c5d1753f29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:28.320521 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556adf4-edf2-464f-ad25-9c5d1753f29c service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:28.320800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556adf4-edf2-464f-ad25-9c5d1753f29c service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:28.321102 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556adf4-edf2-464f-ad25-9c5d1753f29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:28.330682 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556adf4-edf2-464f-ad25-9c5d1753f29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:28.332105 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556adf4-edf2-464f-ad25-9c5d1753f29c service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:28.341959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1407/2788] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:28.655825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01e06e-cc9c-4ec5-b1f2-e5908a6511ef None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:28.657515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9d01e06e-cc9c-4ec5-b1f2-e5908a6511ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:28.671068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01e06e-cc9c-4ec5-b1f2-e5908a6511ef None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:28.675965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:28.676597 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:28.676878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:28.677186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] PATH_INFO: `/v3/projects/b598c8c81c3343e0aabc66d705ab5f43` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:28.678507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b598c8c81c3343e0aabc66d705ab5f43)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:28.680446 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:28.736884 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b598c8c81c3343e0aabc66d705ab5f43', 'request_id': 'req-9f6f85f0-c840-47d4-9ea1-5d084417c607'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.744255 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b598c8c81c3343e0aabc66d705ab5f43', 'request_id': 'req-9f6f85f0-c840-47d4-9ea1-5d084417c607'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.750438 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b598c8c81c3343e0aabc66d705ab5f43', 'request_id': 'req-9f6f85f0-c840-47d4-9ea1-5d084417c607'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.763917 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] The token cache is being invalidate because project b598c8c81c3343e0aabc66d705ab5f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:28.764203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.764809 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.766285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1382/2789] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:28 2022] DELETE /identity/v3/projects/b598c8c81c3343e0aabc66d705ab5f43 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:28.770337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556adf4-edf2-464f-ad25-9c5d1753f29c service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:28.779916 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556adf4-edf2-464f-ad25-9c5d1753f29c service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:28.835080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:28.835706 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:28.835988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:28.836269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] PATH_INFO: `/v3/users/a88f2320072a428289e19249fc719f87` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:28.837409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88f2320072a428289e19249fc719f87)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:28.839294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:28.883323 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88f2320072a428289e19249fc719f87'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.883966 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88f2320072a428289e19249fc719f87'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.890854 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88f2320072a428289e19249fc719f87'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.897889 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:28.904451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88f2320072a428289e19249fc719f87'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.905402 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-f1fa4869-03bd-4aca-9d6f-7056afded17d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88f2320072a428289e19249fc719f87'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:28.917615 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1408/2790] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:43:28 2022] DELETE /identity/v3/users/a88f2320072a428289e19249fc719f87 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:43:29.192924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:29.194492 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:29.209611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f85f0-c840-47d4-9ea1-5d084417c607 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:29.267576 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:29.268209 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:29.268490 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:29.268824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] PATH_INFO: `/v3/projects/b36f1e2df709464e8bc492feff49b562` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:29.269972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36f1e2df709464e8bc492feff49b562)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:29.271857 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:29.279584 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:29.319124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36f1e2df709464e8bc492feff49b562', 'request_id': 'req-8dd1060b-eba1-4d22-b774-1187bf0fed7b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:29.324988 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36f1e2df709464e8bc492feff49b562', 'request_id': 'req-8dd1060b-eba1-4d22-b774-1187bf0fed7b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:29.330410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36f1e2df709464e8bc492feff49b562', 'request_id': 'req-8dd1060b-eba1-4d22-b774-1187bf0fed7b'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:29.342176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] The token cache is being invalidate because project b36f1e2df709464e8bc492feff49b562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:43:29.342466 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:29.343087 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:43:29.344824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1383/2791] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:43:29 2022] DELETE /identity/v3/projects/b36f1e2df709464e8bc492feff49b562 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:43:38.914141 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=5,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:39.339324 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:43:50.202787 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4f3b1-bf44-4aeb-857f-2cd86352ed0f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:50.203333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4f3b1-bf44-4aeb-857f-2cd86352ed0f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:50.203333 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4f3b1-bf44-4aeb-857f-2cd86352ed0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:50.223227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cda4f3b1-bf44-4aeb-857f-2cd86352ed0f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:50.224406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cda4f3b1-bf44-4aeb-857f-2cd86352ed0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:50.283147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1409/2792] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:50.307414 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:50.308832 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:50.381427 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1060b-eba1-4d22-b774-1187bf0fed7b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:50.386785 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20a02c-4fc7-4848-b286-4ca237ab4159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:50.387494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20a02c-4fc7-4848-b286-4ca237ab4159 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:50.387773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20a02c-4fc7-4848-b286-4ca237ab4159 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:50.388039 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20a02c-4fc7-4848-b286-4ca237ab4159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:50.396082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20a02c-4fc7-4848-b286-4ca237ab4159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:50.397707 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20a02c-4fc7-4848-b286-4ca237ab4159 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:50.406793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1384/2793] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:53.265626 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3dcd7-0aad-422d-9c41-61cee5a08498 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:53.266179 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3dcd7-0aad-422d-9c41-61cee5a08498 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:53.266179 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3dcd7-0aad-422d-9c41-61cee5a08498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:53.284935 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-35c3dcd7-0aad-422d-9c41-61cee5a08498 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:53.286145 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-35c3dcd7-0aad-422d-9c41-61cee5a08498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:53.294332 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1410/2794] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:53.320802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20a02c-4fc7-4848-b286-4ca237ab4159 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:53.322232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1e20a02c-4fc7-4848-b286-4ca237ab4159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:53.336451 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20a02c-4fc7-4848-b286-4ca237ab4159 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:53.342048 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbec092-7637-4b73-a2d7-c640861de878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:53.342628 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbec092-7637-4b73-a2d7-c640861de878 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:53.342904 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbec092-7637-4b73-a2d7-c640861de878 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:53.343187 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbec092-7637-4b73-a2d7-c640861de878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:53.351685 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbec092-7637-4b73-a2d7-c640861de878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:53.353308 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbec092-7637-4b73-a2d7-c640861de878 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:53.363775 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1385/2795] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:56.509171 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c464e-f3d1-4989-9fd4-7386e4b6cda1 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:56.509743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c464e-f3d1-4989-9fd4-7386e4b6cda1 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:56.509743 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c464e-f3d1-4989-9fd4-7386e4b6cda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:56.529606 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-154c464e-f3d1-4989-9fd4-7386e4b6cda1 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:56.530788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-154c464e-f3d1-4989-9fd4-7386e4b6cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:56.539197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1411/2796] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:56.559106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbec092-7637-4b73-a2d7-c640861de878 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:56.570338 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbec092-7637-4b73-a2d7-c640861de878 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:56.575783 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d019-5a35-4f4b-ba6a-d3a9d1b2186a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:56.576366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d019-5a35-4f4b-ba6a-d3a9d1b2186a service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:56.576678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d019-5a35-4f4b-ba6a-d3a9d1b2186a service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:56.576983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d019-5a35-4f4b-ba6a-d3a9d1b2186a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:56.584807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62d019-5a35-4f4b-ba6a-d3a9d1b2186a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:56.586409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62d019-5a35-4f4b-ba6a-d3a9d1b2186a service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:56.595800 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1386/2797] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:43:59.604376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924d46-8e14-4135-9c0d-d283f57e0832 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:59.604856 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924d46-8e14-4135-9c0d-d283f57e0832 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:59.605016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924d46-8e14-4135-9c0d-d283f57e0832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:59.626145 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-15924d46-8e14-4135-9c0d-d283f57e0832 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:43:59.627287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-15924d46-8e14-4135-9c0d-d283f57e0832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:43:59.635388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1412/2798] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:43:59.657506 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d019-5a35-4f4b-ba6a-d3a9d1b2186a service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:43:59.670668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d019-5a35-4f4b-ba6a-d3a9d1b2186a service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:43:59.677070 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa57b6-bc28-4d0c-9ebf-0883bfdceac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:43:59.677674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa57b6-bc28-4d0c-9ebf-0883bfdceac8 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:43:59.677957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa57b6-bc28-4d0c-9ebf-0883bfdceac8 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:43:59.678232 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa57b6-bc28-4d0c-9ebf-0883bfdceac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:43:59.686660 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa57b6-bc28-4d0c-9ebf-0883bfdceac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:43:59.688242 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa57b6-bc28-4d0c-9ebf-0883bfdceac8 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:43:59.698648 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1387/2799] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:03.783273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a56819-66f7-458c-99d4-e169d92584ba None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:03.783823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a56819-66f7-458c-99d4-e169d92584ba None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:03.783931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a56819-66f7-458c-99d4-e169d92584ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:03.802599 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-16a56819-66f7-458c-99d4-e169d92584ba None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:03.803770 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-16a56819-66f7-458c-99d4-e169d92584ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:03.811412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1413/2800] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:03.834243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa57b6-bc28-4d0c-9ebf-0883bfdceac8 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:03.845624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa57b6-bc28-4d0c-9ebf-0883bfdceac8 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:03.851566 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e27a2c-e2a6-48ed-924d-8cb0e92462b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:03.852151 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e27a2c-e2a6-48ed-924d-8cb0e92462b9 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:03.852432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e27a2c-e2a6-48ed-924d-8cb0e92462b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:03.852703 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e27a2c-e2a6-48ed-924d-8cb0e92462b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:03.860578 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e27a2c-e2a6-48ed-924d-8cb0e92462b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:03.862811 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e27a2c-e2a6-48ed-924d-8cb0e92462b9 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:03.872535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1388/2801] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:07.969991 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4167f5-f8a9-4607-86af-0c0355065679 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:07.970995 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4167f5-f8a9-4607-86af-0c0355065679 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:07.971163 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4167f5-f8a9-4607-86af-0c0355065679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:07.990293 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-8c4167f5-f8a9-4607-86af-0c0355065679 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:07.991463 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-8c4167f5-f8a9-4607-86af-0c0355065679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:07.999008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1414/2802] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:08.021329 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e27a2c-e2a6-48ed-924d-8cb0e92462b9 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:08.033134 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e27a2c-e2a6-48ed-924d-8cb0e92462b9 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:08.038708 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1104c1-6d69-4334-a1fe-582418b2b9b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:08.039300 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1104c1-6d69-4334-a1fe-582418b2b9b9 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:08.039580 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1104c1-6d69-4334-a1fe-582418b2b9b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:08.039851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1104c1-6d69-4334-a1fe-582418b2b9b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:08.047760 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1104c1-6d69-4334-a1fe-582418b2b9b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:08.049349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1104c1-6d69-4334-a1fe-582418b2b9b9 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:08.058465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1389/2803] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:14.584146 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4167f5-f8a9-4607-86af-0c0355065679 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:14.598492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4167f5-f8a9-4607-86af-0c0355065679 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:14.605269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d0bf-0c6b-4ca9-96f4-2bd39d8260a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:14.609575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d0bf-0c6b-4ca9-96f4-2bd39d8260a2 service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:14.611512 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d0bf-0c6b-4ca9-96f4-2bd39d8260a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:14.617236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d0bf-0c6b-4ca9-96f4-2bd39d8260a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:14.619317 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b460d0bf-0c6b-4ca9-96f4-2bd39d8260a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:14.635371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460d0bf-0c6b-4ca9-96f4-2bd39d8260a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:14.637353 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460d0bf-0c6b-4ca9-96f4-2bd39d8260a2 service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:14.652090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1415/2804] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:18.054669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=64 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:24.646445 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=48 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:24.671630 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1104c1-6d69-4334-a1fe-582418b2b9b9 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:24.673147 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8d1104c1-6d69-4334-a1fe-582418b2b9b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:24.728182 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1104c1-6d69-4334-a1fe-582418b2b9b9 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:24.732320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf878e-a948-465a-b1b7-3dceac51857a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:24.732914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf878e-a948-465a-b1b7-3dceac51857a service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:24.733225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf878e-a948-465a-b1b7-3dceac51857a service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:24.733496 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf878e-a948-465a-b1b7-3dceac51857a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:24.735172 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4ddf878e-a948-465a-b1b7-3dceac51857a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:24.746726 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf878e-a948-465a-b1b7-3dceac51857a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:24.748757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf878e-a948-465a-b1b7-3dceac51857a service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:24.758367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1390/2805] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:25.275940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9c9c-10c2-46f1-8524-db802df9b940 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:25.276501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9c9c-10c2-46f1-8524-db802df9b940 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:25.276772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9c9c-10c2-46f1-8524-db802df9b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:25.296694 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-172a9c9c-10c2-46f1-8524-db802df9b940 None None] MFA Rules not processed for user `cf22d3aa1f254eb8ac59e777be927d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:25.297946 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-172a9c9c-10c2-46f1-8524-db802df9b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:25.353667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1416/2806] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:26.175177 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf878e-a948-465a-b1b7-3dceac51857a service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:26.176624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-4ddf878e-a948-465a-b1b7-3dceac51857a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:26.262014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf878e-a948-465a-b1b7-3dceac51857a service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:26.267269 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e9b69-bf36-4b09-b47a-4923524734ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:26.267878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e9b69-bf36-4b09-b47a-4923524734ff service placement] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:26.268159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e9b69-bf36-4b09-b47a-4923524734ff service placement] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:26.268432 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e9b69-bf36-4b09-b47a-4923524734ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:26.270163 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-7a7e9b69-bf36-4b09-b47a-4923524734ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:26.282692 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e9b69-bf36-4b09-b47a-4923524734ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:26.284271 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e9b69-bf36-4b09-b47a-4923524734ff service placement] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:26.294934 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1391/2807] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:28.646738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9c9c-10c2-46f1-8524-db802df9b940 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:28.649167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-172a9c9c-10c2-46f1-8524-db802df9b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:28.665348 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9c9c-10c2-46f1-8524-db802df9b940 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:28.670496 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:28.671128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:28.671406 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:28.671679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] PATH_INFO: `/v3/users/79deff91d5c046c4bbe7b2e47b21ba66` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:28.686972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79deff91d5c046c4bbe7b2e47b21ba66)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:28.688928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:28.745690 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79deff91d5c046c4bbe7b2e47b21ba66'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:28.746903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79deff91d5c046c4bbe7b2e47b21ba66'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:28.754357 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79deff91d5c046c4bbe7b2e47b21ba66'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:28.768199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79deff91d5c046c4bbe7b2e47b21ba66'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:28.768819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b383b98d-3aa2-4712-9074-05579b37bb06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79deff91d5c046c4bbe7b2e47b21ba66'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:28.782631 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1417/2808] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:44:28 2022] DELETE /identity/v3/users/79deff91d5c046c4bbe7b2e47b21ba66 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:29.005439 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e9b69-bf36-4b09-b47a-4923524734ff service placement] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:29.030970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e9b69-bf36-4b09-b47a-4923524734ff service placement] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:29.090659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:29.091391 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.091738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.092079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] PATH_INFO: `/v3/projects/f34a990da86941db80b177b5c91be377` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.103103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34a990da86941db80b177b5c91be377)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:29.105191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:29.138888 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:29.162442 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34a990da86941db80b177b5c91be377', 'request_id': 'req-b20e423b-2643-4baf-b275-a7a9a6f3a682'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:29.171801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34a990da86941db80b177b5c91be377', 'request_id': 'req-b20e423b-2643-4baf-b275-a7a9a6f3a682'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:29.178605 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34a990da86941db80b177b5c91be377', 'request_id': 'req-b20e423b-2643-4baf-b275-a7a9a6f3a682'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:29.193886 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] The token cache is being invalidate because project f34a990da86941db80b177b5c91be377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:44:29.194467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:29.195286 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-b20e423b-2643-4baf-b275-a7a9a6f3a682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:29.197738 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1392/2809] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:44:29 2022] DELETE /identity/v3/projects/f34a990da86941db80b177b5c91be377 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:29.201904 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792878c1-61a0-4b35-91ac-173d66672581 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.202201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792878c1-61a0-4b35-91ac-173d66672581 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.202474 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792878c1-61a0-4b35-91ac-173d66672581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.222763 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-792878c1-61a0-4b35-91ac-173d66672581 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:29.223981 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-792878c1-61a0-4b35-91ac-173d66672581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:29.283858 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1418/2810] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:29.291429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd215e-c775-4c2b-9302-5f9412ececdd None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.291745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd215e-c775-4c2b-9302-5f9412ececdd None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.292020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd215e-c775-4c2b-9302-5f9412ececdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.311834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-9ecd215e-c775-4c2b-9302-5f9412ececdd None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:29.313277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-9ecd215e-c775-4c2b-9302-5f9412ececdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:29.321142 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1393/2811] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:44:29.325375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792878c1-61a0-4b35-91ac-173d66672581 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:29.335099 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792878c1-61a0-4b35-91ac-173d66672581 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:29.340218 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c607b-aea7-4bfc-85a0-888c397de974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:29.340974 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c607b-aea7-4bfc-85a0-888c397de974 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.341329 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c607b-aea7-4bfc-85a0-888c397de974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.341669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c607b-aea7-4bfc-85a0-888c397de974 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.342416 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c607b-aea7-4bfc-85a0-888c397de974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:44:29.342722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c607b-aea7-4bfc-85a0-888c397de974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:29.344295 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c607b-aea7-4bfc-85a0-888c397de974 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:29.346081 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:29.361387 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1419/2812] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:44:29.366001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd215e-c775-4c2b-9302-5f9412ececdd None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:29.375410 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd215e-c775-4c2b-9302-5f9412ececdd None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:29.380135 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eafa86-e3b0-4769-9e35-cfd600338748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:29.380841 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eafa86-e3b0-4769-9e35-cfd600338748 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.381220 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eafa86-e3b0-4769-9e35-cfd600338748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.381559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eafa86-e3b0-4769-9e35-cfd600338748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.382194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eafa86-e3b0-4769-9e35-cfd600338748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:29.384101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eafa86-e3b0-4769-9e35-cfd600338748 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:29.416018 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1394/2813] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:44:29 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:44:29.417195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c607b-aea7-4bfc-85a0-888c397de974 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:29.427683 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c607b-aea7-4bfc-85a0-888c397de974 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:29.492208 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3311299-833f-4696-993e-0628be0739f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:29.492841 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3311299-833f-4696-993e-0628be0739f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.493156 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3311299-833f-4696-993e-0628be0739f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.493431 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3311299-833f-4696-993e-0628be0739f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.494057 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3311299-833f-4696-993e-0628be0739f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:29.496488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3311299-833f-4696-993e-0628be0739f0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:29.524528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1420/2814] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:44:29 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:44:29.526115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eafa86-e3b0-4769-9e35-cfd600338748 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:29.541474 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eafa86-e3b0-4769-9e35-cfd600338748 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:29.547011 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dead54-9c1a-4b0e-8a9e-2ca917487167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:29.547612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dead54-9c1a-4b0e-8a9e-2ca917487167 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.547891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dead54-9c1a-4b0e-8a9e-2ca917487167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.548170 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dead54-9c1a-4b0e-8a9e-2ca917487167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.548987 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dead54-9c1a-4b0e-8a9e-2ca917487167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:29.550430 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dead54-9c1a-4b0e-8a9e-2ca917487167 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:29.561246 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1395/2815] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:29.566772 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3311299-833f-4696-993e-0628be0739f0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:29.579624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3311299-833f-4696-993e-0628be0739f0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:29.584829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a049ce0-9595-421b-8446-8b80cf417a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:29.585453 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a049ce0-9595-421b-8446-8b80cf417a89 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.585731 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a049ce0-9595-421b-8446-8b80cf417a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.586002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a049ce0-9595-421b-8446-8b80cf417a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.586635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a049ce0-9595-421b-8446-8b80cf417a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:29.588206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a049ce0-9595-421b-8446-8b80cf417a89 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:29.600184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1421/2816] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:29.604937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dead54-9c1a-4b0e-8a9e-2ca917487167 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:29.617712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dead54-9c1a-4b0e-8a9e-2ca917487167 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:29.622535 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b1cd0-58cb-4c48-994d-b418a26faeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:29.623196 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b1cd0-58cb-4c48-994d-b418a26faeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.623478 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b1cd0-58cb-4c48-994d-b418a26faeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.623756 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b1cd0-58cb-4c48-994d-b418a26faeeb admin admin] PATH_INFO: `/v3/projects/820bf0bb7efd48609005cff282cf8b4f/users/a95d636f486f492a874e0593f6fb41c0/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.639250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b1cd0-58cb-4c48-994d-b418a26faeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=820bf0bb7efd48609005cff282cf8b4f, user_id=a95d636f486f492a874e0593f6fb41c0, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:29.641908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b1cd0-58cb-4c48-994d-b418a26faeeb admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:29.655325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1396/2817] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:44:29 2022] PUT /identity/v3/projects/820bf0bb7efd48609005cff282cf8b4f/users/a95d636f486f492a874e0593f6fb41c0/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:29.666704 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebffe4-3cce-4edc-ad07-d3184f635964 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.667204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebffe4-3cce-4edc-ad07-d3184f635964 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.667378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebffe4-3cce-4edc-ad07-d3184f635964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.694829 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cbebffe4-3cce-4edc-ad07-d3184f635964 None None] MFA Rules not processed for user `a95d636f486f492a874e0593f6fb41c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:29.696097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cbebffe4-3cce-4edc-ad07-d3184f635964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:29.762164 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1422/2818] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:29.766649 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b1cd0-58cb-4c48-994d-b418a26faeeb admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:29.828406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b1cd0-58cb-4c48-994d-b418a26faeeb admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:29.833865 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb1dda-7216-4454-b57c-188f0d8e2702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:29.834070 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb1dda-7216-4454-b57c-188f0d8e2702 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.834356 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb1dda-7216-4454-b57c-188f0d8e2702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.834620 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb1dda-7216-4454-b57c-188f0d8e2702 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.835312 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb1dda-7216-4454-b57c-188f0d8e2702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:29.837218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb1dda-7216-4454-b57c-188f0d8e2702 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:29.866185 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1397/2819] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:44:29 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:44:29.870257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebffe4-3cce-4edc-ad07-d3184f635964 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:29.881227 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebffe4-3cce-4edc-ad07-d3184f635964 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:29.939129 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee20e1-f648-4d42-a43e-c8ece564d1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:29.939735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee20e1-f648-4d42-a43e-c8ece564d1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.940014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee20e1-f648-4d42-a43e-c8ece564d1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.940284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee20e1-f648-4d42-a43e-c8ece564d1f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.940905 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee20e1-f648-4d42-a43e-c8ece564d1f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:29.942818 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee20e1-f648-4d42-a43e-c8ece564d1f0 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:29.952073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:29.964114 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1423/2820] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:44:29 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:44:29.968694 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb1dda-7216-4454-b57c-188f0d8e2702 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:29.978887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb1dda-7216-4454-b57c-188f0d8e2702 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:29.984024 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca1c47-4600-48be-8e1b-b7d67938ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:29.984611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca1c47-4600-48be-8e1b-b7d67938ecef admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:29.984887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca1c47-4600-48be-8e1b-b7d67938ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:29.985184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca1c47-4600-48be-8e1b-b7d67938ecef admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:29.985816 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca1c47-4600-48be-8e1b-b7d67938ecef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:29.987370 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca1c47-4600-48be-8e1b-b7d67938ecef admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:29.998444 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1398/2821] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:30.002610 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee20e1-f648-4d42-a43e-c8ece564d1f0 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:30.012473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee20e1-f648-4d42-a43e-c8ece564d1f0 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:30.017091 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ba18a-70a8-4dc1-848c-b83c5e27ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:30.017723 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ba18a-70a8-4dc1-848c-b83c5e27ebdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:30.017998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ba18a-70a8-4dc1-848c-b83c5e27ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:30.018269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ba18a-70a8-4dc1-848c-b83c5e27ebdf admin admin] PATH_INFO: `/v3/projects/425d7b9899f94775aa6b6396e48a2ea4/users/d4adbe6d2aa3400fa5cff6be073ec1c3/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:30.033014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ba18a-70a8-4dc1-848c-b83c5e27ebdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=425d7b9899f94775aa6b6396e48a2ea4, user_id=d4adbe6d2aa3400fa5cff6be073ec1c3, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:30.035659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ba18a-70a8-4dc1-848c-b83c5e27ebdf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:30.048837 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1424/2822] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:44:30 2022] PUT /identity/v3/projects/425d7b9899f94775aa6b6396e48a2ea4/users/d4adbe6d2aa3400fa5cff6be073ec1c3/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:30.052689 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca1c47-4600-48be-8e1b-b7d67938ecef admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:30.062519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca1c47-4600-48be-8e1b-b7d67938ecef admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:30.081825 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:30.121749 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8209920-ee3f-412e-b072-aeda774aab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:30.122348 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8209920-ee3f-412e-b072-aeda774aab28 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:30.122624 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8209920-ee3f-412e-b072-aeda774aab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:30.122895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8209920-ee3f-412e-b072-aeda774aab28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:30.123519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8209920-ee3f-412e-b072-aeda774aab28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:30.125123 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8209920-ee3f-412e-b072-aeda774aab28 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:30.134382 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1399/2823] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:30.138533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ba18a-70a8-4dc1-848c-b83c5e27ebdf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:30.150469 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ba18a-70a8-4dc1-848c-b83c5e27ebdf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:30.155568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e08d1-8297-4bf8-bebc-2f63b0ddc363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:30.156210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e08d1-8297-4bf8-bebc-2f63b0ddc363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:30.156487 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e08d1-8297-4bf8-bebc-2f63b0ddc363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:30.156753 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e08d1-8297-4bf8-bebc-2f63b0ddc363 admin admin] PATH_INFO: `/v3/projects/425d7b9899f94775aa6b6396e48a2ea4/users/d4adbe6d2aa3400fa5cff6be073ec1c3/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:30.158668 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e08d1-8297-4bf8-bebc-2f63b0ddc363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425d7b9899f94775aa6b6396e48a2ea4, user_id=d4adbe6d2aa3400fa5cff6be073ec1c3, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:30.161268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e08d1-8297-4bf8-bebc-2f63b0ddc363 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:30.171068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1425/2824] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:44:30 2022] PUT /identity/v3/projects/425d7b9899f94775aa6b6396e48a2ea4/users/d4adbe6d2aa3400fa5cff6be073ec1c3/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:30.181296 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3b4df-f905-4cd8-a584-6bb634925486 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:30.181654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3b4df-f905-4cd8-a584-6bb634925486 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:30.181935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3b4df-f905-4cd8-a584-6bb634925486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:30.215527 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-1ac3b4df-f905-4cd8-a584-6bb634925486 None None] MFA Rules not processed for user `d4adbe6d2aa3400fa5cff6be073ec1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:30.217181 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-1ac3b4df-f905-4cd8-a584-6bb634925486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:30.301374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1400/2825] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:30.313290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e08d1-8297-4bf8-bebc-2f63b0ddc363 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:30.315022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-752e08d1-8297-4bf8-bebc-2f63b0ddc363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:30.372493 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e08d1-8297-4bf8-bebc-2f63b0ddc363 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:30.376071 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a8cd8-135c-4073-ac84-70d0ba9cbc8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:30.376665 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a8cd8-135c-4073-ac84-70d0ba9cbc8b service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:30.376938 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a8cd8-135c-4073-ac84-70d0ba9cbc8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:30.377233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a8cd8-135c-4073-ac84-70d0ba9cbc8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:30.386203 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a8cd8-135c-4073-ac84-70d0ba9cbc8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:30.387602 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a8cd8-135c-4073-ac84-70d0ba9cbc8b service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:30.396881 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1426/2826] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:30.811367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3b4df-f905-4cd8-a584-6bb634925486 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:30.871270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3b4df-f905-4cd8-a584-6bb634925486 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:30.875747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:30.876358 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:30.876634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:30.876905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] PATH_INFO: `/v3/users/a95d636f486f492a874e0593f6fb41c0` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:30.878036 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95d636f486f492a874e0593f6fb41c0)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:30.879925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:30.926701 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95d636f486f492a874e0593f6fb41c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:30.928340 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:30.935831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95d636f486f492a874e0593f6fb41c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:30.936672 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95d636f486f492a874e0593f6fb41c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:30.944250 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95d636f486f492a874e0593f6fb41c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:30.957450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95d636f486f492a874e0593f6fb41c0'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:30.965368 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1401/2827] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:44:30 2022] DELETE /identity/v3/users/a95d636f486f492a874e0593f6fb41c0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:30.969820 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e486505-9c21-411e-8ac2-aeccbcf076fd None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:30.970310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e486505-9c21-411e-8ac2-aeccbcf076fd None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:30.970411 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e486505-9c21-411e-8ac2-aeccbcf076fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:30.989154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7e486505-9c21-411e-8ac2-aeccbcf076fd None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:30.990393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7e486505-9c21-411e-8ac2-aeccbcf076fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:31.056270 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1427/2828] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:44:31.068194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:31.070357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:31.135203 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652127a7-78a9-4a04-8bed-938acafefc65 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:31.139420 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2802d-32c0-4d47-ac2d-3fd17a4f8c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:31.140106 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2802d-32c0-4d47-ac2d-3fd17a4f8c4d service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:31.140455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2802d-32c0-4d47-ac2d-3fd17a4f8c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:31.140846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2802d-32c0-4d47-ac2d-3fd17a4f8c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:31.152764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2802d-32c0-4d47-ac2d-3fd17a4f8c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:31.154234 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2802d-32c0-4d47-ac2d-3fd17a4f8c4d service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:31.163528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1402/2829] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:31.419419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e486505-9c21-411e-8ac2-aeccbcf076fd None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:31.420859 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7e486505-9c21-411e-8ac2-aeccbcf076fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:31.434633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e486505-9c21-411e-8ac2-aeccbcf076fd None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:31.439314 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:31.440032 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:31.440380 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:31.440722 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] PATH_INFO: `/v3/projects/820bf0bb7efd48609005cff282cf8b4f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:31.442176 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=820bf0bb7efd48609005cff282cf8b4f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:31.444558 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:31.491801 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820bf0bb7efd48609005cff282cf8b4f', 'request_id': 'req-0a4bd520-271a-41bf-9ba7-09eca7339eab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:31.493725 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:31.499483 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820bf0bb7efd48609005cff282cf8b4f', 'request_id': 'req-0a4bd520-271a-41bf-9ba7-09eca7339eab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:31.506651 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820bf0bb7efd48609005cff282cf8b4f', 'request_id': 'req-0a4bd520-271a-41bf-9ba7-09eca7339eab'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:31.519543 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] The token cache is being invalidate because project 820bf0bb7efd48609005cff282cf8b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:44:31.519835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:31.520452 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:31.521979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1428/2830] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:44:31 2022] DELETE /identity/v3/projects/820bf0bb7efd48609005cff282cf8b4f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:31.525900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2802d-32c0-4d47-ac2d-3fd17a4f8c4d service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:31.535285 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2802d-32c0-4d47-ac2d-3fd17a4f8c4d service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:31.595795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:31.596540 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:31.596819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:31.597125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] PATH_INFO: `/v3/users/d4adbe6d2aa3400fa5cff6be073ec1c3` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:31.598263 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4adbe6d2aa3400fa5cff6be073ec1c3)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:31.600168 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:31.649373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4adbe6d2aa3400fa5cff6be073ec1c3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:31.657603 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4adbe6d2aa3400fa5cff6be073ec1c3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:31.658226 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4adbe6d2aa3400fa5cff6be073ec1c3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:31.665908 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4adbe6d2aa3400fa5cff6be073ec1c3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:31.671161 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:31.679483 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-68712323-80be-4eb6-881c-c88c1c26bc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4adbe6d2aa3400fa5cff6be073ec1c3'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:31.687316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1403/2831] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:44:31 2022] DELETE /identity/v3/users/d4adbe6d2aa3400fa5cff6be073ec1c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:31.965909 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:31.967729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:31.981920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bd520-271a-41bf-9ba7-09eca7339eab admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.042016 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.042658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.042943 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.043246 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] PATH_INFO: `/v3/projects/425d7b9899f94775aa6b6396e48a2ea4` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.044495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425d7b9899f94775aa6b6396e48a2ea4)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.046535 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.093593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425d7b9899f94775aa6b6396e48a2ea4', 'request_id': 'req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:32.100138 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425d7b9899f94775aa6b6396e48a2ea4', 'request_id': 'req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:32.106988 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425d7b9899f94775aa6b6396e48a2ea4', 'request_id': 'req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:32.120368 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] The token cache is being invalidate because project 425d7b9899f94775aa6b6396e48a2ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:44:32.120659 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:32.121310 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c0050b45-b44b-42b1-b2c5-e9d3da3d8999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:32.122792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1429/2832] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:44:31 2022] DELETE /identity/v3/projects/425d7b9899f94775aa6b6396e48a2ea4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:32.128125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ad45-627f-40d2-ac4d-549fce4070a3 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.128638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ad45-627f-40d2-ac4d-549fce4070a3 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.128745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ad45-627f-40d2-ac4d-549fce4070a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.149786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-a0a5ad45-627f-40d2-ac4d-549fce4070a3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:32.151014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a0a5ad45-627f-40d2-ac4d-549fce4070a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:32.212858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1404/2833] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:32.221292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4fe8b-756a-4941-a16b-9748ea02d484 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.221585 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4fe8b-756a-4941-a16b-9748ea02d484 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.221863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4fe8b-756a-4941-a16b-9748ea02d484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.242933 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-61e4fe8b-756a-4941-a16b-9748ea02d484 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:32.243529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-61e4fe8b-756a-4941-a16b-9748ea02d484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:32.252976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1430/2834] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:32.256531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5ad45-627f-40d2-ac4d-549fce4070a3 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.266268 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5ad45-627f-40d2-ac4d-549fce4070a3 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.270767 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2927f0-ee4b-4349-9609-9387c958a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.271357 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2927f0-ee4b-4349-9609-9387c958a51c admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.271640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2927f0-ee4b-4349-9609-9387c958a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.271914 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2927f0-ee4b-4349-9609-9387c958a51c admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.272552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2927f0-ee4b-4349-9609-9387c958a51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:44:32.272855 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2927f0-ee4b-4349-9609-9387c958a51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.274456 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2927f0-ee4b-4349-9609-9387c958a51c admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.286194 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1405/2835] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:44:32.290375 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4fe8b-756a-4941-a16b-9748ea02d484 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.300029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4fe8b-756a-4941-a16b-9748ea02d484 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.304794 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd10da-4a14-40cc-9d75-b00f19e8c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.305458 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd10da-4a14-40cc-9d75-b00f19e8c27a admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.305744 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd10da-4a14-40cc-9d75-b00f19e8c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.306018 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd10da-4a14-40cc-9d75-b00f19e8c27a admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.306680 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd10da-4a14-40cc-9d75-b00f19e8c27a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.308625 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd10da-4a14-40cc-9d75-b00f19e8c27a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.335290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1431/2836] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:44:32 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:44:32.339902 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2927f0-ee4b-4349-9609-9387c958a51c admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.349677 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2927f0-ee4b-4349-9609-9387c958a51c admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.405745 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032564d7-ffdc-4fb9-a9c4-92df0dd4a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.406345 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032564d7-ffdc-4fb9-a9c4-92df0dd4a77b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.406629 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032564d7-ffdc-4fb9-a9c4-92df0dd4a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.406906 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032564d7-ffdc-4fb9-a9c4-92df0dd4a77b admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.407546 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032564d7-ffdc-4fb9-a9c4-92df0dd4a77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.409480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032564d7-ffdc-4fb9-a9c4-92df0dd4a77b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.430998 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1406/2837] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:44:32 2022] POST /identity/v3/users => generated 278 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:44:32.435660 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd10da-4a14-40cc-9d75-b00f19e8c27a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.445923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd10da-4a14-40cc-9d75-b00f19e8c27a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.451739 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5541a0-e092-47c7-a197-ee244bfce5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.452337 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5541a0-e092-47c7-a197-ee244bfce5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.452614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5541a0-e092-47c7-a197-ee244bfce5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.452883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5541a0-e092-47c7-a197-ee244bfce5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.453624 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5541a0-e092-47c7-a197-ee244bfce5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.455441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5541a0-e092-47c7-a197-ee244bfce5a9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.465346 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1432/2838] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:32.469254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032564d7-ffdc-4fb9-a9c4-92df0dd4a77b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.479487 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032564d7-ffdc-4fb9-a9c4-92df0dd4a77b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.484283 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f134e80-b1a6-4051-a510-adfb347520d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.484936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f134e80-b1a6-4051-a510-adfb347520d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.485243 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f134e80-b1a6-4051-a510-adfb347520d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.485534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f134e80-b1a6-4051-a510-adfb347520d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.486528 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f134e80-b1a6-4051-a510-adfb347520d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.488027 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f134e80-b1a6-4051-a510-adfb347520d6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.503971 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1407/2839] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:32.505324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5541a0-e092-47c7-a197-ee244bfce5a9 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.516029 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5541a0-e092-47c7-a197-ee244bfce5a9 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.520600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b4548-5d8f-46e6-92fe-499557df215c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.521257 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b4548-5d8f-46e6-92fe-499557df215c admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.521533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b4548-5d8f-46e6-92fe-499557df215c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.521804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b4548-5d8f-46e6-92fe-499557df215c admin admin] PATH_INFO: `/v3/projects/89b2a4612d244835bce5a45a4a88b06d/users/ea35a558101e454696f3ac3ceaaa4814/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.536462 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b4548-5d8f-46e6-92fe-499557df215c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b2a4612d244835bce5a45a4a88b06d, user_id=ea35a558101e454696f3ac3ceaaa4814, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.539119 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b4548-5d8f-46e6-92fe-499557df215c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.552035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1433/2840] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:44:32 2022] PUT /identity/v3/projects/89b2a4612d244835bce5a45a4a88b06d/users/ea35a558101e454696f3ac3ceaaa4814/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:44:32.563909 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ea995-9474-4e75-83e4-8db2697e3ff4 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.564200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ea995-9474-4e75-83e4-8db2697e3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.564477 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ea995-9474-4e75-83e4-8db2697e3ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.593517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-887ea995-9474-4e75-83e4-8db2697e3ff4 None None] MFA Rules not processed for user `ea35a558101e454696f3ac3ceaaa4814`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:32.594722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-887ea995-9474-4e75-83e4-8db2697e3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:32.640736 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:32.665596 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1408/2841] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:32.670124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b4548-5d8f-46e6-92fe-499557df215c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.679008 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:32.734835 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b4548-5d8f-46e6-92fe-499557df215c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.739522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27faabb5-afca-490e-9540-cd9b137eb642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.740118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faabb5-afca-490e-9540-cd9b137eb642 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.740399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faabb5-afca-490e-9540-cd9b137eb642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.740674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faabb5-afca-490e-9540-cd9b137eb642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.741327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27faabb5-afca-490e-9540-cd9b137eb642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.743206 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27faabb5-afca-490e-9540-cd9b137eb642 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.771504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1434/2842] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:44:32 2022] POST /identity/v3/projects => generated 355 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:44:32.784640 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ea995-9474-4e75-83e4-8db2697e3ff4 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.795218 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ea995-9474-4e75-83e4-8db2697e3ff4 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.849582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a744d9-15ae-4a3c-ba1a-a9c6e18cc03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.850175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a744d9-15ae-4a3c-ba1a-a9c6e18cc03d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.850460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a744d9-15ae-4a3c-ba1a-a9c6e18cc03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.850732 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a744d9-15ae-4a3c-ba1a-a9c6e18cc03d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.851359 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a744d9-15ae-4a3c-ba1a-a9c6e18cc03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.853277 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a744d9-15ae-4a3c-ba1a-a9c6e18cc03d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.874313 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1409/2843] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:44:32 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:44:32.878412 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27faabb5-afca-490e-9540-cd9b137eb642 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.888627 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27faabb5-afca-490e-9540-cd9b137eb642 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.893420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7dda6-2029-4508-aa92-eb8993e41923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.894010 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7dda6-2029-4508-aa92-eb8993e41923 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.894294 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7dda6-2029-4508-aa92-eb8993e41923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.894568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7dda6-2029-4508-aa92-eb8993e41923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.895201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7dda6-2029-4508-aa92-eb8993e41923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.896809 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7dda6-2029-4508-aa92-eb8993e41923 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.907340 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1435/2844] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:32.911293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a744d9-15ae-4a3c-ba1a-a9c6e18cc03d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.921722 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a744d9-15ae-4a3c-ba1a-a9c6e18cc03d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:32.926363 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0424070-a009-41e4-8789-33004febf8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:32.927225 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0424070-a009-41e4-8789-33004febf8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:32.927502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0424070-a009-41e4-8789-33004febf8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:32.927779 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0424070-a009-41e4-8789-33004febf8c6 admin admin] PATH_INFO: `/v3/projects/48bb13ae619f46fc907eb2b81618464b/users/3b2365539b494e468fb3e1d3c4716991/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:32.943732 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0424070-a009-41e4-8789-33004febf8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bb13ae619f46fc907eb2b81618464b, user_id=3b2365539b494e468fb3e1d3c4716991, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:32.946341 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0424070-a009-41e4-8789-33004febf8c6 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:32.959764 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1410/2845] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:44:32 2022] PUT /identity/v3/projects/48bb13ae619f46fc907eb2b81618464b/users/3b2365539b494e468fb3e1d3c4716991/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:32.963765 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7dda6-2029-4508-aa92-eb8993e41923 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:32.973813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7dda6-2029-4508-aa92-eb8993e41923 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:33.030017 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013861c8-85f6-4f9e-95f6-25053e754d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:33.030647 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013861c8-85f6-4f9e-95f6-25053e754d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:33.030888 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013861c8-85f6-4f9e-95f6-25053e754d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:33.031162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013861c8-85f6-4f9e-95f6-25053e754d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:33.031794 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013861c8-85f6-4f9e-95f6-25053e754d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:33.033418 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013861c8-85f6-4f9e-95f6-25053e754d68 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:33.043540 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1436/2846] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:33.047721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0424070-a009-41e4-8789-33004febf8c6 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:33.057956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0424070-a009-41e4-8789-33004febf8c6 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:33.062559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a8167-e1f8-44df-a896-be13b54b2029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:33.063233 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a8167-e1f8-44df-a896-be13b54b2029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:33.063511 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a8167-e1f8-44df-a896-be13b54b2029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:33.063781 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a8167-e1f8-44df-a896-be13b54b2029 admin admin] PATH_INFO: `/v3/projects/48bb13ae619f46fc907eb2b81618464b/users/3b2365539b494e468fb3e1d3c4716991/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:33.065667 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a8167-e1f8-44df-a896-be13b54b2029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bb13ae619f46fc907eb2b81618464b, user_id=3b2365539b494e468fb3e1d3c4716991, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:33.068259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a8167-e1f8-44df-a896-be13b54b2029 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:33.078198 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1411/2847] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:44:33 2022] PUT /identity/v3/projects/48bb13ae619f46fc907eb2b81618464b/users/3b2365539b494e468fb3e1d3c4716991/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:33.088322 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb487f9-05d8-4a4c-bed4-2f9a80cecf7c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:33.089160 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb487f9-05d8-4a4c-bed4-2f9a80cecf7c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:33.089441 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb487f9-05d8-4a4c-bed4-2f9a80cecf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:33.117236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-cfb487f9-05d8-4a4c-bed4-2f9a80cecf7c None None] MFA Rules not processed for user `3b2365539b494e468fb3e1d3c4716991`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:33.118468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-cfb487f9-05d8-4a4c-bed4-2f9a80cecf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:33.185751 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1437/2848] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:33.197050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a8167-e1f8-44df-a896-be13b54b2029 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:33.198817 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-724a8167-e1f8-44df-a896-be13b54b2029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:33.258780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a8167-e1f8-44df-a896-be13b54b2029 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:33.262570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5836b-eaf3-4eb9-8be3-d377c158ac16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:33.263175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5836b-eaf3-4eb9-8be3-d377c158ac16 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:33.263453 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5836b-eaf3-4eb9-8be3-d377c158ac16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:33.263751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5836b-eaf3-4eb9-8be3-d377c158ac16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:33.274567 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5836b-eaf3-4eb9-8be3-d377c158ac16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:33.275669 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5836b-eaf3-4eb9-8be3-d377c158ac16 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:33.286223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1412/2849] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:33.369785 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb487f9-05d8-4a4c-bed4-2f9a80cecf7c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:33.374430 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:33.383605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb487f9-05d8-4a4c-bed4-2f9a80cecf7c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:33.388420 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebc53e-0cf5-4771-ad20-9b0adb526128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:33.389534 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc53e-0cf5-4771-ad20-9b0adb526128 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:33.390592 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc53e-0cf5-4771-ad20-9b0adb526128 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:33.391144 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc53e-0cf5-4771-ad20-9b0adb526128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:33.456551 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebc53e-0cf5-4771-ad20-9b0adb526128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:33.458027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebc53e-0cf5-4771-ad20-9b0adb526128 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:33.468095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1438/2850] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:35.346918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5836b-eaf3-4eb9-8be3-d377c158ac16 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:35.348369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-a4a5836b-eaf3-4eb9-8be3-d377c158ac16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:35.420077 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:35.457060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5836b-eaf3-4eb9-8be3-d377c158ac16 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:35.462320 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a72412-de6e-43cc-8a29-f9432e6ad447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:35.462921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72412-de6e-43cc-8a29-f9432e6ad447 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:35.463735 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72412-de6e-43cc-8a29-f9432e6ad447 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:35.464004 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a72412-de6e-43cc-8a29-f9432e6ad447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:35.465723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c3a72412-de6e-43cc-8a29-f9432e6ad447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:35.477381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a72412-de6e-43cc-8a29-f9432e6ad447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:35.479581 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a72412-de6e-43cc-8a29-f9432e6ad447 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:35.489750 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1413/2851] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:44:40.931605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2efd-53e4-4b28-afaa-6f023eec780f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:40.932132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2efd-53e4-4b28-afaa-6f023eec780f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:40.932132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2efd-53e4-4b28-afaa-6f023eec780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:40.951666 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-4a0a2efd-53e4-4b28-afaa-6f023eec780f None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:40.953140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-4a0a2efd-53e4-4b28-afaa-6f023eec780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:41.011222 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1439/2852] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:41.031674 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a72412-de6e-43cc-8a29-f9432e6ad447 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:41.033181 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-c3a72412-de6e-43cc-8a29-f9432e6ad447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:41.046950 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a72412-de6e-43cc-8a29-f9432e6ad447 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:41.052499 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75135a-1fc7-4f4b-a346-0a60b44f2928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:41.053119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75135a-1fc7-4f4b-a346-0a60b44f2928 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:41.053405 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75135a-1fc7-4f4b-a346-0a60b44f2928 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:41.053683 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75135a-1fc7-4f4b-a346-0a60b44f2928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:41.061829 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75135a-1fc7-4f4b-a346-0a60b44f2928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:41.063424 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75135a-1fc7-4f4b-a346-0a60b44f2928 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:41.073454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1414/2853] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:44.194655 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14082a36-b949-44a9-81ea-0a9f30645ada None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:44.195212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14082a36-b949-44a9-81ea-0a9f30645ada None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:44.195212 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14082a36-b949-44a9-81ea-0a9f30645ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:44.217093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-14082a36-b949-44a9-81ea-0a9f30645ada None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:44.218292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-14082a36-b949-44a9-81ea-0a9f30645ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:44.226271 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1440/2854] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:44.252682 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75135a-1fc7-4f4b-a346-0a60b44f2928 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:44.264887 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75135a-1fc7-4f4b-a346-0a60b44f2928 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:44.275229 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d2f0d-8419-427b-91bd-98c866044b8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:44.275823 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d2f0d-8419-427b-91bd-98c866044b8a service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:44.276101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d2f0d-8419-427b-91bd-98c866044b8a service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:44.276374 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d2f0d-8419-427b-91bd-98c866044b8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:44.284721 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d2f0d-8419-427b-91bd-98c866044b8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:44.286310 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d2f0d-8419-427b-91bd-98c866044b8a service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:44.296200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1415/2855] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:44:47.308049 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f8727-df01-4ae6-9c15-a9290885db1a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:47.308567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f8727-df01-4ae6-9c15-a9290885db1a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:47.308674 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f8727-df01-4ae6-9c15-a9290885db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:47.328766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-909f8727-df01-4ae6-9c15-a9290885db1a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:47.330014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-909f8727-df01-4ae6-9c15-a9290885db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:47.338911 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1441/2856] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:47.361060 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d2f0d-8419-427b-91bd-98c866044b8a service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:47.373599 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d2f0d-8419-427b-91bd-98c866044b8a service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:47.379696 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af299bb-613e-45b8-923d-8c26685e97b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:47.380434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af299bb-613e-45b8-923d-8c26685e97b4 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:47.380754 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af299bb-613e-45b8-923d-8c26685e97b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:47.381074 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af299bb-613e-45b8-923d-8c26685e97b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:47.389455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af299bb-613e-45b8-923d-8c26685e97b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:47.391013 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af299bb-613e-45b8-923d-8c26685e97b4 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:47.400851 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1416/2857] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:48.245715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f8727-df01-4ae6-9c15-a9290885db1a None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:48.255163 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f8727-df01-4ae6-9c15-a9290885db1a None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:48.260204 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:48.260816 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:48.261134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:48.261409 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] PATH_INFO: `/v3/users/ea35a558101e454696f3ac3ceaaa4814` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:48.262516 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea35a558101e454696f3ac3ceaaa4814)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:48.264413 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:48.311140 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea35a558101e454696f3ac3ceaaa4814'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:48.311788 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea35a558101e454696f3ac3ceaaa4814'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:48.318999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea35a558101e454696f3ac3ceaaa4814'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:48.332747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea35a558101e454696f3ac3ceaaa4814'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:48.333494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea35a558101e454696f3ac3ceaaa4814'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:48.347384 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:48.358000 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1442/2858] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:44:48 2022] DELETE /identity/v3/users/ea35a558101e454696f3ac3ceaaa4814 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:48.358186 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f1925-e303-4f7e-a6ed-02b412b0690a None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:48.358507 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f1925-e303-4f7e-a6ed-02b412b0690a None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:48.358783 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f1925-e303-4f7e-a6ed-02b412b0690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:48.378365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-b58f1925-e303-4f7e-a6ed-02b412b0690a None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:48.379544 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b58f1925-e303-4f7e-a6ed-02b412b0690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:48.436967 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1417/2859] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:44:48.447335 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:48.448713 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:48.505230 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e21b4-d2b8-48e9-91b0-905ba9c13315 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:48.509296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2227bec-413d-4a63-b7eb-9297d28c98bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:48.509893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2227bec-413d-4a63-b7eb-9297d28c98bc service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:48.510172 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2227bec-413d-4a63-b7eb-9297d28c98bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:48.510440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2227bec-413d-4a63-b7eb-9297d28c98bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:48.519566 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2227bec-413d-4a63-b7eb-9297d28c98bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:48.521055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2227bec-413d-4a63-b7eb-9297d28c98bc service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:48.531096 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1443/2860] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:48.794641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f1925-e303-4f7e-a6ed-02b412b0690a None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:48.796101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-b58f1925-e303-4f7e-a6ed-02b412b0690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:48.808841 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f1925-e303-4f7e-a6ed-02b412b0690a None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:48.813936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:48.814568 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:48.815057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:48.815349 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] PATH_INFO: `/v3/projects/89b2a4612d244835bce5a45a4a88b06d` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:48.816702 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b2a4612d244835bce5a45a4a88b06d)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:48.818797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:48.868020 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b2a4612d244835bce5a45a4a88b06d', 'request_id': 'req-8baefe1f-8070-4721-b853-94bd5af68fb1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:48.875564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b2a4612d244835bce5a45a4a88b06d', 'request_id': 'req-8baefe1f-8070-4721-b853-94bd5af68fb1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:48.881995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b2a4612d244835bce5a45a4a88b06d', 'request_id': 'req-8baefe1f-8070-4721-b853-94bd5af68fb1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:48.893972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] The token cache is being invalidate because project 89b2a4612d244835bce5a45a4a88b06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:44:48.894263 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:48.894901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:48.896386 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1418/2861] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:44:48 2022] DELETE /identity/v3/projects/89b2a4612d244835bce5a45a4a88b06d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:48.900918 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2227bec-413d-4a63-b7eb-9297d28c98bc service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:48.910358 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2227bec-413d-4a63-b7eb-9297d28c98bc service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:48.967247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:48.967870 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:48.968152 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:48.968421 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] PATH_INFO: `/v3/users/3b2365539b494e468fb3e1d3c4716991` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:48.969545 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2365539b494e468fb3e1d3c4716991)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:48.971427 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:49.015968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2365539b494e468fb3e1d3c4716991'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:49.016597 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2365539b494e468fb3e1d3c4716991'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:49.024301 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2365539b494e468fb3e1d3c4716991'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:49.036015 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2365539b494e468fb3e1d3c4716991'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:49.036656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-a3820963-16de-478e-b4bc-e437fb650313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2365539b494e468fb3e1d3c4716991'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:49.049586 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1444/2862] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:44:48 2022] DELETE /identity/v3/users/3b2365539b494e468fb3e1d3c4716991 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:49.329460 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:49.330962 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:49.347966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baefe1f-8070-4721-b853-94bd5af68fb1 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:49.352571 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:49.414293 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:49.414970 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:49.415185 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:49.415454 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] PATH_INFO: `/v3/projects/48bb13ae619f46fc907eb2b81618464b` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:49.416552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48bb13ae619f46fc907eb2b81618464b)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:49.418500 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:49.465276 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48bb13ae619f46fc907eb2b81618464b', 'request_id': 'req-90005f1a-aca2-42bc-9be3-88ad70006323'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:49.471307 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48bb13ae619f46fc907eb2b81618464b', 'request_id': 'req-90005f1a-aca2-42bc-9be3-88ad70006323'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:49.477309 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48bb13ae619f46fc907eb2b81618464b', 'request_id': 'req-90005f1a-aca2-42bc-9be3-88ad70006323'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:49.489318 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] The token cache is being invalidate because project 48bb13ae619f46fc907eb2b81618464b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:44:49.489611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:49.490231 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-90005f1a-aca2-42bc-9be3-88ad70006323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:49.492299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1419/2863] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:44:49 2022] DELETE /identity/v3/projects/48bb13ae619f46fc907eb2b81618464b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:49.497305 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9fe4e-3e8e-4e52-8ec7-03e2deec71df None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:49.497789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9fe4e-3e8e-4e52-8ec7-03e2deec71df None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:49.497895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9fe4e-3e8e-4e52-8ec7-03e2deec71df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:49.517260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-31d9fe4e-3e8e-4e52-8ec7-03e2deec71df None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:49.518451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-31d9fe4e-3e8e-4e52-8ec7-03e2deec71df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:49.536248 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:49.582192 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1445/2864] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:49.591793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ac1fd-0ece-4bef-9244-68eaf8b1fe54 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:49.592191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ac1fd-0ece-4bef-9244-68eaf8b1fe54 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:49.592477 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ac1fd-0ece-4bef-9244-68eaf8b1fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:49.614131 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6c7ac1fd-0ece-4bef-9244-68eaf8b1fe54 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:49.615392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6c7ac1fd-0ece-4bef-9244-68eaf8b1fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:49.624534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1420/2865] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:49.628727 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9fe4e-3e8e-4e52-8ec7-03e2deec71df None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:49.638749 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9fe4e-3e8e-4e52-8ec7-03e2deec71df None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:49.643288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544cc90-52eb-4b3e-8aad-19eaac019325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:49.643875 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544cc90-52eb-4b3e-8aad-19eaac019325 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:49.644151 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544cc90-52eb-4b3e-8aad-19eaac019325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:49.644419 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544cc90-52eb-4b3e-8aad-19eaac019325 admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:49.645095 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544cc90-52eb-4b3e-8aad-19eaac019325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:44:49.645398 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544cc90-52eb-4b3e-8aad-19eaac019325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:49.646968 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544cc90-52eb-4b3e-8aad-19eaac019325 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:49.658635 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1446/2866] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:44:49.663495 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ac1fd-0ece-4bef-9244-68eaf8b1fe54 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:49.672712 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ac1fd-0ece-4bef-9244-68eaf8b1fe54 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:49.677306 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adc4a0-0c54-4ced-8786-49e283b5aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:49.677891 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adc4a0-0c54-4ced-8786-49e283b5aa92 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:49.678166 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adc4a0-0c54-4ced-8786-49e283b5aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:49.678458 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adc4a0-0c54-4ced-8786-49e283b5aa92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:49.679082 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8adc4a0-0c54-4ced-8786-49e283b5aa92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:49.680965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8adc4a0-0c54-4ced-8786-49e283b5aa92 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:49.706598 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1421/2867] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:44:49 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:44:49.711082 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544cc90-52eb-4b3e-8aad-19eaac019325 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:49.721014 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544cc90-52eb-4b3e-8aad-19eaac019325 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:49.779671 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a6904-76f2-4375-a7e9-7569e54cc098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:49.780302 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a6904-76f2-4375-a7e9-7569e54cc098 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:49.780588 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a6904-76f2-4375-a7e9-7569e54cc098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:49.780863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a6904-76f2-4375-a7e9-7569e54cc098 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:49.781550 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a6904-76f2-4375-a7e9-7569e54cc098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:49.783467 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a6904-76f2-4375-a7e9-7569e54cc098 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:49.804929 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1447/2868] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:44:49 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:44:49.808989 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adc4a0-0c54-4ced-8786-49e283b5aa92 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:49.819212 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adc4a0-0c54-4ced-8786-49e283b5aa92 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:49.823846 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bde902-f29b-492a-aa76-18455da1127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:49.824437 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bde902-f29b-492a-aa76-18455da1127b admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:49.824718 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bde902-f29b-492a-aa76-18455da1127b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:49.825018 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bde902-f29b-492a-aa76-18455da1127b admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:49.825658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bde902-f29b-492a-aa76-18455da1127b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:49.827494 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bde902-f29b-492a-aa76-18455da1127b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:49.838154 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1422/2869] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:44:49.841893 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a6904-76f2-4375-a7e9-7569e54cc098 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:49.852284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a6904-76f2-4375-a7e9-7569e54cc098 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:49.856842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71828236-d554-42d6-9723-53f3439848b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:49.857529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71828236-d554-42d6-9723-53f3439848b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:49.857814 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71828236-d554-42d6-9723-53f3439848b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:49.858093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71828236-d554-42d6-9723-53f3439848b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:49.858729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71828236-d554-42d6-9723-53f3439848b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:49.860349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71828236-d554-42d6-9723-53f3439848b3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:49.870813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1448/2870] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:49.874739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bde902-f29b-492a-aa76-18455da1127b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:49.885038 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bde902-f29b-492a-aa76-18455da1127b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:49.889575 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175aa35-07d7-4636-bdf9-5098a0bbc207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:49.890199 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175aa35-07d7-4636-bdf9-5098a0bbc207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:49.890475 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175aa35-07d7-4636-bdf9-5098a0bbc207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:49.890747 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175aa35-07d7-4636-bdf9-5098a0bbc207 admin admin] PATH_INFO: `/v3/projects/2100b50f11ed48388ccd0eed51153c31/users/bb3465cc14124a8390db417ef066c290/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:49.905531 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175aa35-07d7-4636-bdf9-5098a0bbc207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2100b50f11ed48388ccd0eed51153c31, user_id=bb3465cc14124a8390db417ef066c290, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:49.908110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175aa35-07d7-4636-bdf9-5098a0bbc207 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:49.920849 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1423/2871] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:44:49 2022] PUT /identity/v3/projects/2100b50f11ed48388ccd0eed51153c31/users/bb3465cc14124a8390db417ef066c290/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:49.931046 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f9a81-8fce-4819-b4f6-af0e73ff071f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:49.931339 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f9a81-8fce-4819-b4f6-af0e73ff071f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:49.931619 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f9a81-8fce-4819-b4f6-af0e73ff071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:49.959268 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-445f9a81-8fce-4819-b4f6-af0e73ff071f None None] MFA Rules not processed for user `bb3465cc14124a8390db417ef066c290`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:49.960593 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-445f9a81-8fce-4819-b4f6-af0e73ff071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:50.023031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1449/2872] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:50.027532 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175aa35-07d7-4636-bdf9-5098a0bbc207 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.060842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:50.088727 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175aa35-07d7-4636-bdf9-5098a0bbc207 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.093289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dceabd-9ef0-42ee-b4f9-4afcd098ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.093878 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dceabd-9ef0-42ee-b4f9-4afcd098ae87 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.094159 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dceabd-9ef0-42ee-b4f9-4afcd098ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.094431 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dceabd-9ef0-42ee-b4f9-4afcd098ae87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.095057 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dceabd-9ef0-42ee-b4f9-4afcd098ae87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.096969 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dceabd-9ef0-42ee-b4f9-4afcd098ae87 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.123006 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1424/2873] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:44:50 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:44:50.127184 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f9a81-8fce-4819-b4f6-af0e73ff071f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.137824 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f9a81-8fce-4819-b4f6-af0e73ff071f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.150669 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:50.195525 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e932839-108b-42b0-b8b4-cbc4bd479ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.196131 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932839-108b-42b0-b8b4-cbc4bd479ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.196435 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932839-108b-42b0-b8b4-cbc4bd479ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.196709 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932839-108b-42b0-b8b4-cbc4bd479ebf admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.197371 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e932839-108b-42b0-b8b4-cbc4bd479ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.199267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e932839-108b-42b0-b8b4-cbc4bd479ebf admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.220124 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1450/2874] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:44:50 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:44:50.224195 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dceabd-9ef0-42ee-b4f9-4afcd098ae87 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.234972 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dceabd-9ef0-42ee-b4f9-4afcd098ae87 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.239658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7e731-fc64-4671-8c43-834c4ad5ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.240239 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e731-fc64-4671-8c43-834c4ad5ba05 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.240516 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e731-fc64-4671-8c43-834c4ad5ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.240787 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e731-fc64-4671-8c43-834c4ad5ba05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.242041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7e731-fc64-4671-8c43-834c4ad5ba05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.243641 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7e731-fc64-4671-8c43-834c4ad5ba05 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.253977 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1425/2875] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:50.257792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e932839-108b-42b0-b8b4-cbc4bd479ebf admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.267504 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e932839-108b-42b0-b8b4-cbc4bd479ebf admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.272646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ce460-f35a-44b4-a76c-ad995432f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.273288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ce460-f35a-44b4-a76c-ad995432f6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.273567 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ce460-f35a-44b4-a76c-ad995432f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.273863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ce460-f35a-44b4-a76c-ad995432f6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.274501 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ce460-f35a-44b4-a76c-ad995432f6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.276058 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ce460-f35a-44b4-a76c-ad995432f6b7 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.285853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1451/2876] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:44:50.289974 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7e731-fc64-4671-8c43-834c4ad5ba05 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.299623 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7e731-fc64-4671-8c43-834c4ad5ba05 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.304608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d2131-2054-4c31-a93e-7506de356a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.305395 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d2131-2054-4c31-a93e-7506de356a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.305670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d2131-2054-4c31-a93e-7506de356a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.305940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d2131-2054-4c31-a93e-7506de356a5e admin admin] PATH_INFO: `/v3/projects/78214f9281424f7bb95f450faa4daf2a/users/61ca3abf70ff486c94364a7129c25722/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.320273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d2131-2054-4c31-a93e-7506de356a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=78214f9281424f7bb95f450faa4daf2a, user_id=61ca3abf70ff486c94364a7129c25722, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.322881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d2131-2054-4c31-a93e-7506de356a5e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.336801 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1426/2877] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:44:50 2022] PUT /identity/v3/projects/78214f9281424f7bb95f450faa4daf2a/users/61ca3abf70ff486c94364a7129c25722/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:44:50.347863 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4b20-ac59-410c-a385-5a6a954dc68a None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.348150 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4b20-ac59-410c-a385-5a6a954dc68a None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.348425 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4b20-ac59-410c-a385-5a6a954dc68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.377573 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-3d8f4b20-ac59-410c-a385-5a6a954dc68a None None] MFA Rules not processed for user `61ca3abf70ff486c94364a7129c25722`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:50.378779 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3d8f4b20-ac59-410c-a385-5a6a954dc68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:50.447766 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1452/2878] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:50.452476 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d2131-2054-4c31-a93e-7506de356a5e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.486640 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99614fb-8f2f-4fb1-9fae-a4c244033129 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.486923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99614fb-8f2f-4fb1-9fae-a4c244033129 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.487197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99614fb-8f2f-4fb1-9fae-a4c244033129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.506774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d99614fb-8f2f-4fb1-9fae-a4c244033129 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:50.507964 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d99614fb-8f2f-4fb1-9fae-a4c244033129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:50.518553 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d2131-2054-4c31-a93e-7506de356a5e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.523947 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c0b95-3b18-4675-84ac-1abc9da14661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.524550 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0b95-3b18-4675-84ac-1abc9da14661 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.524831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0b95-3b18-4675-84ac-1abc9da14661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.525141 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0b95-3b18-4675-84ac-1abc9da14661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.525773 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0b95-3b18-4675-84ac-1abc9da14661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.527658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0b95-3b18-4675-84ac-1abc9da14661 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.557001 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1427/2879] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:44:50 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:44:50.560905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c0b95-3b18-4675-84ac-1abc9da14661 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.569429 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1453/2880] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:44:50.593532 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99614fb-8f2f-4fb1-9fae-a4c244033129 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.594834 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d99614fb-8f2f-4fb1-9fae-a4c244033129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:50.621814 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c0b95-3b18-4675-84ac-1abc9da14661 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.625352 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:50.626497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80c1a8-d2b2-45be-8d75-b65a2dbf9f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.627097 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80c1a8-d2b2-45be-8d75-b65a2dbf9f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.627381 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80c1a8-d2b2-45be-8d75-b65a2dbf9f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.627680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80c1a8-d2b2-45be-8d75-b65a2dbf9f80 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.628280 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80c1a8-d2b2-45be-8d75-b65a2dbf9f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.630213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80c1a8-d2b2-45be-8d75-b65a2dbf9f80 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.646252 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:50.655288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1428/2881] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:44:50 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:44:50.656525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80c1a8-d2b2-45be-8d75-b65a2dbf9f80 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.666794 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80c1a8-d2b2-45be-8d75-b65a2dbf9f80 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.671376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4df0-0526-4192-ac44-b47e7e9a2f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.672079 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4df0-0526-4192-ac44-b47e7e9a2f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.672360 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4df0-0526-4192-ac44-b47e7e9a2f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.672630 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4df0-0526-4192-ac44-b47e7e9a2f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.673302 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c4df0-0526-4192-ac44-b47e7e9a2f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.674132 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99614fb-8f2f-4fb1-9fae-a4c244033129 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.674899 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c4df0-0526-4192-ac44-b47e7e9a2f14 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.686174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1429/2882] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:44:50.690116 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4df0-0526-4192-ac44-b47e7e9a2f14 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.699992 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4df0-0526-4192-ac44-b47e7e9a2f14 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.704990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ef63c-15cc-4248-b24d-823f8f1bc57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.705616 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ef63c-15cc-4248-b24d-823f8f1bc57f admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.705900 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ef63c-15cc-4248-b24d-823f8f1bc57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.706176 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ef63c-15cc-4248-b24d-823f8f1bc57f admin admin] PATH_INFO: `/v3/projects/01b62a02b8da48f880d7b51b570cfba8/users/db5612e638424c2b956cabdca949918c/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.720467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ef63c-15cc-4248-b24d-823f8f1bc57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b62a02b8da48f880d7b51b570cfba8, user_id=db5612e638424c2b956cabdca949918c, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.723175 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ef63c-15cc-4248-b24d-823f8f1bc57f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.736769 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1430/2883] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:44:50 2022] PUT /identity/v3/projects/01b62a02b8da48f880d7b51b570cfba8/users/db5612e638424c2b956cabdca949918c/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 10:44:50.740577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ef63c-15cc-4248-b24d-823f8f1bc57f admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.745771 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc9aa4-e0fb-4472-b8d8-f588f3d90f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.746388 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9aa4-e0fb-4472-b8d8-f588f3d90f4d service nova] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.746663 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9aa4-e0fb-4472-b8d8-f588f3d90f4d service nova] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.746934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9aa4-e0fb-4472-b8d8-f588f3d90f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.757482 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc9aa4-e0fb-4472-b8d8-f588f3d90f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.760528 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc9aa4-e0fb-4472-b8d8-f588f3d90f4d service nova] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.773985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1454/2884] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:44:50.801953 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ef63c-15cc-4248-b24d-823f8f1bc57f admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.807090 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6935e3-272f-4876-a17c-b88a2623588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.807835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6935e3-272f-4876-a17c-b88a2623588f admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.807963 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6935e3-272f-4876-a17c-b88a2623588f admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.808235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6935e3-272f-4876-a17c-b88a2623588f admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.808940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6935e3-272f-4876-a17c-b88a2623588f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.810644 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6935e3-272f-4876-a17c-b88a2623588f admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.820911 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1431/2885] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:44:50.825408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc9aa4-e0fb-4472-b8d8-f588f3d90f4d service nova] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.835944 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc9aa4-e0fb-4472-b8d8-f588f3d90f4d service nova] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:50.840523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2b57d-4c41-463c-a56d-94b6c4af9765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:50.841199 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2b57d-4c41-463c-a56d-94b6c4af9765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.841481 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2b57d-4c41-463c-a56d-94b6c4af9765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.841755 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2b57d-4c41-463c-a56d-94b6c4af9765 admin admin] PATH_INFO: `/v3/projects/01b62a02b8da48f880d7b51b570cfba8/users/db5612e638424c2b956cabdca949918c/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.843735 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2b57d-4c41-463c-a56d-94b6c4af9765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b62a02b8da48f880d7b51b570cfba8, user_id=db5612e638424c2b956cabdca949918c, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:50.846326 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2b57d-4c41-463c-a56d-94b6c4af9765 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:50.856842 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1455/2886] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:44:50 2022] PUT /identity/v3/projects/01b62a02b8da48f880d7b51b570cfba8/users/db5612e638424c2b956cabdca949918c/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:50.868189 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccabe6-abfe-4396-99c7-f36a90b91d0f None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:50.868635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccabe6-abfe-4396-99c7-f36a90b91d0f None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:50.868918 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccabe6-abfe-4396-99c7-f36a90b91d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:50.897739 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-ecccabe6-abfe-4396-99c7-f36a90b91d0f None None] MFA Rules not processed for user `db5612e638424c2b956cabdca949918c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:50.898956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-ecccabe6-abfe-4396-99c7-f36a90b91d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:50.970091 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1432/2887] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:50.981355 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2b57d-4c41-463c-a56d-94b6c4af9765 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:50.983097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-88d2b57d-4c41-463c-a56d-94b6c4af9765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:51.040518 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2b57d-4c41-463c-a56d-94b6c4af9765 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:51.044251 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e224e9-b42b-41f4-b803-752998b0e7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:51.044850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e224e9-b42b-41f4-b803-752998b0e7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:51.045167 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e224e9-b42b-41f4-b803-752998b0e7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:51.045440 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e224e9-b42b-41f4-b803-752998b0e7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:51.054959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e224e9-b42b-41f4-b803-752998b0e7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:51.056378 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e224e9-b42b-41f4-b803-752998b0e7f3 service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:51.065729 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1456/2888] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:51.555515 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccabe6-abfe-4396-99c7-f36a90b91d0f None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:51.565087 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccabe6-abfe-4396-99c7-f36a90b91d0f None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:51.568731 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd95bec-d3e2-4ba4-9e35-e3e5d7db1aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:51.569376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd95bec-d3e2-4ba4-9e35-e3e5d7db1aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:51.569659 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd95bec-d3e2-4ba4-9e35-e3e5d7db1aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:51.569995 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd95bec-d3e2-4ba4-9e35-e3e5d7db1aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:51.611552 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:51.627819 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd95bec-d3e2-4ba4-9e35-e3e5d7db1aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:51.629216 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd95bec-d3e2-4ba4-9e35-e3e5d7db1aa9 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:51.638062 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1433/2889] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:54.680849 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc70f5-d125-4a22-be95-039c0ec86cf6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:54.681448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc70f5-d125-4a22-be95-039c0ec86cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:54.681448 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc70f5-d125-4a22-be95-039c0ec86cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:54.701819 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-d9cc70f5-d125-4a22-be95-039c0ec86cf6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:54.703035 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-d9cc70f5-d125-4a22-be95-039c0ec86cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:54.737031 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:54.765998 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1457/2890] 10.222.0.55 () {58 vars in 1016 bytes} [Mon Sep 26 10:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:54.871025 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd95bec-d3e2-4ba4-9e35-e3e5d7db1aa9 service cinder] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:54.872480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-dfd95bec-d3e2-4ba4-9e35-e3e5d7db1aa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:54.943569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd95bec-d3e2-4ba4-9e35-e3e5d7db1aa9 service cinder] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:54.948852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf27a8c-3194-429f-b999-c4ec00765e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58300ef26a547028e837ba2da615991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:54.949615 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf27a8c-3194-429f-b999-c4ec00765e35 service nova] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:54.949895 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf27a8c-3194-429f-b999-c4ec00765e35 service nova] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:54.950429 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf27a8c-3194-429f-b999-c4ec00765e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:54.959041 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf27a8c-3194-429f-b999-c4ec00765e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:54.960619 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf27a8c-3194-429f-b999-c4ec00765e35 service nova] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:54.970114 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1434/2891] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:55.832232 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc70f5-d125-4a22-be95-039c0ec86cf6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:55.841900 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc70f5-d125-4a22-be95-039c0ec86cf6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:55.845485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b29950-7be9-44f9-9356-4ad2a4915c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:55.846089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29950-7be9-44f9-9356-4ad2a4915c8d service cinder] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:55.846369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29950-7be9-44f9-9356-4ad2a4915c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:55.846641 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29950-7be9-44f9-9356-4ad2a4915c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:55.902738 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29950-7be9-44f9-9356-4ad2a4915c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:55.904080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29950-7be9-44f9-9356-4ad2a4915c8d service cinder] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:55.912790 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1458/2892] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:57.998167 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf27a8c-3194-429f-b999-c4ec00765e35 service nova] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:58.008278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf27a8c-3194-429f-b999-c4ec00765e35 service nova] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:58.012905 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:58.013549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:58.013828 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:58.014098 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] PATH_INFO: `/v3/users/bb3465cc14124a8390db417ef066c290` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:58.015208 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3465cc14124a8390db417ef066c290)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:58.017124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:58.062213 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3465cc14124a8390db417ef066c290'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.070108 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3465cc14124a8390db417ef066c290'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.070870 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3465cc14124a8390db417ef066c290'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.079289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3465cc14124a8390db417ef066c290'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.091072 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3465cc14124a8390db417ef066c290'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.096873 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1435/2893] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:44:57 2022] DELETE /identity/v3/users/bb3465cc14124a8390db417ef066c290 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:58.101818 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e0dba-e6e0-435e-b139-79a677405bcb None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:58.102292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e0dba-e6e0-435e-b139-79a677405bcb None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:58.102399 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e0dba-e6e0-435e-b139-79a677405bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:58.121557 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-a56e0dba-e6e0-435e-b139-79a677405bcb None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:44:58.122774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a56e0dba-e6e0-435e-b139-79a677405bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:58.183839 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1459/2894] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:44:58.193561 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:58.194965 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:58.237964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:58.253791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb1897-2e74-4cb0-8cf4-8f5b0772d5f3 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:58.257958 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5109fe8-e86a-402d-a2b4-36c2021d466e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:58.258559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109fe8-e86a-402d-a2b4-36c2021d466e service neutron] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:58.258835 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109fe8-e86a-402d-a2b4-36c2021d466e service neutron] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:58.259104 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109fe8-e86a-402d-a2b4-36c2021d466e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:58.267930 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5109fe8-e86a-402d-a2b4-36c2021d466e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:58.269373 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5109fe8-e86a-402d-a2b4-36c2021d466e service neutron] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:58.279207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1436/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:44:58.549611 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e0dba-e6e0-435e-b139-79a677405bcb None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:58.551027 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-a56e0dba-e6e0-435e-b139-79a677405bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:58.562895 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e0dba-e6e0-435e-b139-79a677405bcb None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:58.567582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:58.568224 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:58.568506 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:58.568774 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] PATH_INFO: `/v3/projects/2100b50f11ed48388ccd0eed51153c31` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:58.569917 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2100b50f11ed48388ccd0eed51153c31)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:58.571874 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:58.623992 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2100b50f11ed48388ccd0eed51153c31', 'request_id': 'req-732123bd-ccd6-4c05-b9f7-66068a299071'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.630912 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2100b50f11ed48388ccd0eed51153c31', 'request_id': 'req-732123bd-ccd6-4c05-b9f7-66068a299071'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.638840 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2100b50f11ed48388ccd0eed51153c31', 'request_id': 'req-732123bd-ccd6-4c05-b9f7-66068a299071'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.651679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] The token cache is being invalidate because project 2100b50f11ed48388ccd0eed51153c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:44:58.651979 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.652581 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.654115 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1460/2896] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:44:58 2022] DELETE /identity/v3/projects/2100b50f11ed48388ccd0eed51153c31 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:58.658130 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5109fe8-e86a-402d-a2b4-36c2021d466e service neutron] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:58.667990 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5109fe8-e86a-402d-a2b4-36c2021d466e service neutron] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:58.724526 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:58.725150 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:58.725434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:58.725707 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] PATH_INFO: `/v3/users/61ca3abf70ff486c94364a7129c25722` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:58.726840 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ca3abf70ff486c94364a7129c25722)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:58.728856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:58.782931 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ca3abf70ff486c94364a7129c25722'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.790635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ca3abf70ff486c94364a7129c25722'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.791686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ca3abf70ff486c94364a7129c25722'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.799009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ca3abf70ff486c94364a7129c25722'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.811436 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ca3abf70ff486c94364a7129c25722'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:58.818136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1437/2897] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:44:58 2022] DELETE /identity/v3/users/61ca3abf70ff486c94364a7129c25722 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:59.170363 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:59.172633 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:59.192410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:59.214038 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732123bd-ccd6-4c05-b9f7-66068a299071 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:59.273906 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:59.274451 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:59.274733 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:59.275009 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] PATH_INFO: `/v3/projects/78214f9281424f7bb95f450faa4daf2a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:59.276128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78214f9281424f7bb95f450faa4daf2a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:59.278064 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:59.330073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78214f9281424f7bb95f450faa4daf2a', 'request_id': 'req-c570398e-aed9-446b-9d24-72fc53e4c695'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.337612 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78214f9281424f7bb95f450faa4daf2a', 'request_id': 'req-c570398e-aed9-446b-9d24-72fc53e4c695'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.343434 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78214f9281424f7bb95f450faa4daf2a', 'request_id': 'req-c570398e-aed9-446b-9d24-72fc53e4c695'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.360737 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] The token cache is being invalidate because project 78214f9281424f7bb95f450faa4daf2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:44:59.361065 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.361721 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.365113 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1461/2898] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:44:59 2022] DELETE /identity/v3/projects/78214f9281424f7bb95f450faa4daf2a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:59.374601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:59.374601 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:59.384050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8072-ad27-4153-a633-02378fccc2c0 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:59.448983 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:59.454059 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:59.454350 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:59.454716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] PATH_INFO: `/v3/users/db5612e638424c2b956cabdca949918c` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:59.456021 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5612e638424c2b956cabdca949918c)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:59.458673 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:59.461259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:59.514421 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5612e638424c2b956cabdca949918c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.524153 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5612e638424c2b956cabdca949918c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.524822 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5612e638424c2b956cabdca949918c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.532344 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5612e638424c2b956cabdca949918c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.546978 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-3651e891-3e24-42d5-b327-8ac67b074183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5612e638424c2b956cabdca949918c'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.553228 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1438/2899] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:44:59 2022] DELETE /identity/v3/users/db5612e638424c2b956cabdca949918c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:59.824902 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:44:59.826345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:44:59.839292 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570398e-aed9-446b-9d24-72fc53e4c695 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:44:59.896019 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:44:59.896646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:59.896928 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:59.897240 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] PATH_INFO: `/v3/projects/01b62a02b8da48f880d7b51b570cfba8` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:44:59.898377 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b62a02b8da48f880d7b51b570cfba8)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:44:59.900275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:44:59.936210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:59.948269 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b62a02b8da48f880d7b51b570cfba8', 'request_id': 'req-9807e45e-db8e-4c09-9b56-067938822af3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.954632 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b62a02b8da48f880d7b51b570cfba8', 'request_id': 'req-9807e45e-db8e-4c09-9b56-067938822af3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.960769 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b62a02b8da48f880d7b51b570cfba8', 'request_id': 'req-9807e45e-db8e-4c09-9b56-067938822af3'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.973328 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] The token cache is being invalidate because project 01b62a02b8da48f880d7b51b570cfba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:44:59.973618 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.974236 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-9807e45e-db8e-4c09-9b56-067938822af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:44:59.975845 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1462/2900] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:44:59 2022] DELETE /identity/v3/projects/01b62a02b8da48f880d7b51b570cfba8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:44:59.981862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a12f91-ce9c-448b-8607-7bd546a99184 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:44:59.982155 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a12f91-ce9c-448b-8607-7bd546a99184 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:44:59.982434 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a12f91-ce9c-448b-8607-7bd546a99184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.002678 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-08a12f91-ce9c-448b-8607-7bd546a99184 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:00.003881 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-08a12f91-ce9c-448b-8607-7bd546a99184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:00.061668 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1439/2901] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:00.070255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486d7a5-a66a-42c7-aecc-011b92607582 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.070476 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486d7a5-a66a-42c7-aecc-011b92607582 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.070748 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486d7a5-a66a-42c7-aecc-011b92607582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.090932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-b486d7a5-a66a-42c7-aecc-011b92607582 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:00.092128 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b486d7a5-a66a-42c7-aecc-011b92607582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:00.100587 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1463/2902] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:00.104611 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a12f91-ce9c-448b-8607-7bd546a99184 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.114559 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a12f91-ce9c-448b-8607-7bd546a99184 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.119171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79608e90-13a5-47df-9be5-95645422c3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.119757 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79608e90-13a5-47df-9be5-95645422c3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.120035 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79608e90-13a5-47df-9be5-95645422c3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.120304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79608e90-13a5-47df-9be5-95645422c3ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.120964 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79608e90-13a5-47df-9be5-95645422c3ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81437) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:45:00.121275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79608e90-13a5-47df-9be5-95645422c3ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.122876 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79608e90-13a5-47df-9be5-95645422c3ed admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.134577 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1440/2903] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:45:00.138757 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486d7a5-a66a-42c7-aecc-011b92607582 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.148509 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486d7a5-a66a-42c7-aecc-011b92607582 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.153088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c0def-cc34-4d4a-bea6-4e90c192e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.153705 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c0def-cc34-4d4a-bea6-4e90c192e7cc admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.154022 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c0def-cc34-4d4a-bea6-4e90c192e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.154290 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c0def-cc34-4d4a-bea6-4e90c192e7cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.154932 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c0def-cc34-4d4a-bea6-4e90c192e7cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.156791 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c0def-cc34-4d4a-bea6-4e90c192e7cc admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.183055 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1464/2904] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:45:00 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:45:00.187236 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79608e90-13a5-47df-9be5-95645422c3ed admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.197051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79608e90-13a5-47df-9be5-95645422c3ed admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.252260 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35691cd-1e89-4d29-ab14-63857054dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.252862 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35691cd-1e89-4d29-ab14-63857054dd6d admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.253174 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35691cd-1e89-4d29-ab14-63857054dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.253449 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35691cd-1e89-4d29-ab14-63857054dd6d admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.254080 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35691cd-1e89-4d29-ab14-63857054dd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.256009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35691cd-1e89-4d29-ab14-63857054dd6d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.271842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:00.282353 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1441/2905] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:45:00 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:45:00.283570 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c0def-cc34-4d4a-bea6-4e90c192e7cc admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.294461 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c0def-cc34-4d4a-bea6-4e90c192e7cc admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.299109 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e7071-5137-476a-9230-f295bed89c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.299703 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e7071-5137-476a-9230-f295bed89c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.299985 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e7071-5137-476a-9230-f295bed89c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.300260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e7071-5137-476a-9230-f295bed89c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.300903 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e7071-5137-476a-9230-f295bed89c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.302503 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e7071-5137-476a-9230-f295bed89c2b admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.312244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1465/2906] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:45:00.315937 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35691cd-1e89-4d29-ab14-63857054dd6d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.325952 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35691cd-1e89-4d29-ab14-63857054dd6d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.330525 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add1660-82bb-4d72-926b-9a172695e092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.331136 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add1660-82bb-4d72-926b-9a172695e092 admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.331418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add1660-82bb-4d72-926b-9a172695e092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.331691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add1660-82bb-4d72-926b-9a172695e092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.332869 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add1660-82bb-4d72-926b-9a172695e092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.334465 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add1660-82bb-4d72-926b-9a172695e092 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.345842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1442/2907] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:45:00.350614 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e7071-5137-476a-9230-f295bed89c2b admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.360675 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e7071-5137-476a-9230-f295bed89c2b admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.365519 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69fb46-50c2-493a-8167-cb9226b442ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.366241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69fb46-50c2-493a-8167-cb9226b442ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.366526 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69fb46-50c2-493a-8167-cb9226b442ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.366800 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69fb46-50c2-493a-8167-cb9226b442ae admin admin] PATH_INFO: `/v3/projects/7b3045b1df5e48eaa308346bda8ab167/users/bfd99ac8ce0945b6b0788562e957c924/roles/d598e7097e2d496f971598b09965388a` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.381972 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69fb46-50c2-493a-8167-cb9226b442ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3045b1df5e48eaa308346bda8ab167, user_id=bfd99ac8ce0945b6b0788562e957c924, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.384897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69fb46-50c2-493a-8167-cb9226b442ae admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.399288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1466/2908] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:45:00 2022] PUT /identity/v3/projects/7b3045b1df5e48eaa308346bda8ab167/users/bfd99ac8ce0945b6b0788562e957c924/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:00.466815 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea9bcc-865f-4c42-a766-eee943b55a19 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.467399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea9bcc-865f-4c42-a766-eee943b55a19 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.467399 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea9bcc-865f-4c42-a766-eee943b55a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.494716 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-e1ea9bcc-865f-4c42-a766-eee943b55a19 None None] MFA Rules not processed for user `bfd99ac8ce0945b6b0788562e957c924`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:00.495925 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-e1ea9bcc-865f-4c42-a766-eee943b55a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:00.561693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1443/2909] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:00.566093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69fb46-50c2-493a-8167-cb9226b442ae admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.626159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69fb46-50c2-493a-8167-cb9226b442ae admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.631211 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd573d4-ac5b-41c2-a67e-045b168405e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.631797 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd573d4-ac5b-41c2-a67e-045b168405e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.632079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd573d4-ac5b-41c2-a67e-045b168405e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.632349 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd573d4-ac5b-41c2-a67e-045b168405e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.632969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd573d4-ac5b-41c2-a67e-045b168405e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.634846 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd573d4-ac5b-41c2-a67e-045b168405e3 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.661880 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1467/2910] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:45:00 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:45:00.666705 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea9bcc-865f-4c42-a766-eee943b55a19 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.677920 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea9bcc-865f-4c42-a766-eee943b55a19 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.731554 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f6b52-77ba-4830-9f7a-cc86172c77d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.732171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f6b52-77ba-4830-9f7a-cc86172c77d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.732445 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f6b52-77ba-4830-9f7a-cc86172c77d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.732711 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f6b52-77ba-4830-9f7a-cc86172c77d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.733367 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f6b52-77ba-4830-9f7a-cc86172c77d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.735245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f6b52-77ba-4830-9f7a-cc86172c77d5 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.756068 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1444/2911] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:45:00 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:45:00.760129 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd573d4-ac5b-41c2-a67e-045b168405e3 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.770959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd573d4-ac5b-41c2-a67e-045b168405e3 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.775568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9dd00-b800-463f-a586-85cb5db4d906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.776158 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9dd00-b800-463f-a586-85cb5db4d906 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.776439 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9dd00-b800-463f-a586-85cb5db4d906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.776710 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9dd00-b800-463f-a586-85cb5db4d906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.777383 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9dd00-b800-463f-a586-85cb5db4d906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.778934 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9dd00-b800-463f-a586-85cb5db4d906 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.789873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1468/2912] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:45:00.793791 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f6b52-77ba-4830-9f7a-cc86172c77d5 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.804051 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f6b52-77ba-4830-9f7a-cc86172c77d5 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.808795 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108c566-a0fa-44fc-8807-abad72590fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.809462 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108c566-a0fa-44fc-8807-abad72590fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.809743 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108c566-a0fa-44fc-8807-abad72590fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.810044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108c566-a0fa-44fc-8807-abad72590fe2 admin admin] PATH_INFO: `/v3/projects/fabc842631534c3bbe5b646acb43b081/users/d75780469f9941c8a7b1126a28c4901f/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.827836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108c566-a0fa-44fc-8807-abad72590fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabc842631534c3bbe5b646acb43b081, user_id=d75780469f9941c8a7b1126a28c4901f, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.830894 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108c566-a0fa-44fc-8807-abad72590fe2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.845408 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1445/2913] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:45:00 2022] PUT /identity/v3/projects/fabc842631534c3bbe5b646acb43b081/users/d75780469f9941c8a7b1126a28c4901f/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:00.850007 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9dd00-b800-463f-a586-85cb5db4d906 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.860147 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9dd00-b800-463f-a586-85cb5db4d906 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.888923 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:00.918002 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae75e79-a52d-4de6-8033-d0d0f25cd2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.918604 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae75e79-a52d-4de6-8033-d0d0f25cd2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.918886 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae75e79-a52d-4de6-8033-d0d0f25cd2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.919159 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae75e79-a52d-4de6-8033-d0d0f25cd2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.919792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae75e79-a52d-4de6-8033-d0d0f25cd2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.921410 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae75e79-a52d-4de6-8033-d0d0f25cd2c4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.930810 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1469/2914] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 10:45:00.935110 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108c566-a0fa-44fc-8807-abad72590fe2 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:00.945389 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108c566-a0fa-44fc-8807-abad72590fe2 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:00.950654 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe415fe-19f7-4f7a-8665-73b37a264003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:00.951289 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe415fe-19f7-4f7a-8665-73b37a264003 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.951569 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe415fe-19f7-4f7a-8665-73b37a264003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.951854 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe415fe-19f7-4f7a-8665-73b37a264003 admin admin] PATH_INFO: `/v3/projects/fabc842631534c3bbe5b646acb43b081/users/d75780469f9941c8a7b1126a28c4901f/roles/9017bb819fd54a179e1ae8585a831e88` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:00.953751 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe415fe-19f7-4f7a-8665-73b37a264003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabc842631534c3bbe5b646acb43b081, user_id=d75780469f9941c8a7b1126a28c4901f, role_id=9017bb819fd54a179e1ae8585a831e88)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:00.956325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe415fe-19f7-4f7a-8665-73b37a264003 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:00.966777 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1446/2915] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:45:00 2022] PUT /identity/v3/projects/fabc842631534c3bbe5b646acb43b081/users/d75780469f9941c8a7b1126a28c4901f/roles/9017bb819fd54a179e1ae8585a831e88 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:00.977369 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d151f0-f13c-4727-b816-88dcccbe806f None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:00.977656 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d151f0-f13c-4727-b816-88dcccbe806f None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:00.977931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d151f0-f13c-4727-b816-88dcccbe806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:01.006432 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-81d151f0-f13c-4727-b816-88dcccbe806f None None] MFA Rules not processed for user `d75780469f9941c8a7b1126a28c4901f`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:01.007636 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-81d151f0-f13c-4727-b816-88dcccbe806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:01.074783 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1470/2916] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 10:45:01.086831 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe415fe-19f7-4f7a-8665-73b37a264003 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:01.088278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-abe415fe-19f7-4f7a-8665-73b37a264003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:01.119333 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:01.151957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe415fe-19f7-4f7a-8665-73b37a264003 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:01.155538 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c1dd4-af80-48a8-bf97-82d3c3d2a162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:01.156139 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c1dd4-af80-48a8-bf97-82d3c3d2a162 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:01.156418 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c1dd4-af80-48a8-bf97-82d3c3d2a162 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:01.156691 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c1dd4-af80-48a8-bf97-82d3c3d2a162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:01.213099 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c1dd4-af80-48a8-bf97-82d3c3d2a162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:01.214533 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c1dd4-af80-48a8-bf97-82d3c3d2a162 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:01.224149 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1447/2917] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:45:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:45:03.756969 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d151f0-f13c-4727-b816-88dcccbe806f None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:03.825130 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d151f0-f13c-4727-b816-88dcccbe806f None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:03.829629 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:03.830256 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:03.830533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:03.830803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] PATH_INFO: `/v3/users/bfd99ac8ce0945b6b0788562e957c924` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:03.831913 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd99ac8ce0945b6b0788562e957c924)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:03.834201 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:03.880897 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd99ac8ce0945b6b0788562e957c924'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:03.881562 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd99ac8ce0945b6b0788562e957c924'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:03.888210 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd99ac8ce0945b6b0788562e957c924'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:03.889324 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:03.900892 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd99ac8ce0945b6b0788562e957c924'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:03.901533 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd99ac8ce0945b6b0788562e957c924'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:03.914391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1471/2918] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:45:03 2022] DELETE /identity/v3/users/bfd99ac8ce0945b6b0788562e957c924 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:03.918927 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb070f-8ba5-499b-8d2c-1b22decbe130 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:03.919390 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb070f-8ba5-499b-8d2c-1b22decbe130 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:03.919517 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb070f-8ba5-499b-8d2c-1b22decbe130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:03.943834 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-6fbb070f-8ba5-499b-8d2c-1b22decbe130 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:03.945158 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6fbb070f-8ba5-499b-8d2c-1b22decbe130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:04.007480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1448/2919] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:04.017070 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:04.018542 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:04.080792 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8933-1d22-4d90-a834-ecf906a499e5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:04.084912 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9034-6312-41fa-8144-fa461ec838db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:04.085545 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9034-6312-41fa-8144-fa461ec838db service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:04.085826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9034-6312-41fa-8144-fa461ec838db service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:04.086098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9034-6312-41fa-8144-fa461ec838db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:04.095529 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d9034-6312-41fa-8144-fa461ec838db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:04.096960 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d9034-6312-41fa-8144-fa461ec838db service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:04.107347 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1472/2920] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 10:45:04.387227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb070f-8ba5-499b-8d2c-1b22decbe130 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:04.388966 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-6fbb070f-8ba5-499b-8d2c-1b22decbe130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:04.403014 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb070f-8ba5-499b-8d2c-1b22decbe130 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:04.414975 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:04.416171 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:04.416450 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:04.416723 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] PATH_INFO: `/v3/projects/7b3045b1df5e48eaa308346bda8ab167` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:04.418044 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3045b1df5e48eaa308346bda8ab167)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:04.419940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:04.478101 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3045b1df5e48eaa308346bda8ab167', 'request_id': 'req-86c34303-1a93-4998-9a47-8ffd44d2f26d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:04.485549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3045b1df5e48eaa308346bda8ab167', 'request_id': 'req-86c34303-1a93-4998-9a47-8ffd44d2f26d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:04.492288 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3045b1df5e48eaa308346bda8ab167', 'request_id': 'req-86c34303-1a93-4998-9a47-8ffd44d2f26d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:04.506856 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] The token cache is being invalidate because project 7b3045b1df5e48eaa308346bda8ab167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:45:04.507173 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:04.507786 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:04.509352 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1449/2921] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:45:04 2022] DELETE /identity/v3/projects/7b3045b1df5e48eaa308346bda8ab167 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:04.513241 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9034-6312-41fa-8144-fa461ec838db service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:04.523414 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9034-6312-41fa-8144-fa461ec838db service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:04.582415 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:04.583052 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:04.583336 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:04.583613 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] PATH_INFO: `/v3/users/d75780469f9941c8a7b1126a28c4901f` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:04.584747 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75780469f9941c8a7b1126a28c4901f)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:04.586761 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:04.634289 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75780469f9941c8a7b1126a28c4901f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:04.634954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75780469f9941c8a7b1126a28c4901f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:04.642958 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75780469f9941c8a7b1126a28c4901f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:04.656327 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75780469f9941c8a7b1126a28c4901f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:04.657048 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-b90269a2-3ce2-410d-acd5-7a492607372c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75780469f9941c8a7b1126a28c4901f'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:04.660742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:04.673041 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1473/2922] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:45:04 2022] DELETE /identity/v3/users/d75780469f9941c8a7b1126a28c4901f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:04.941452 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:04.943207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:04.959938 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c34303-1a93-4998-9a47-8ffd44d2f26d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:04.964658 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:05.022582 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:05.023133 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.023411 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.023680 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] PATH_INFO: `/v3/projects/fabc842631534c3bbe5b646acb43b081` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.024797 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabc842631534c3bbe5b646acb43b081)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:05.026761 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:05.084235 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabc842631534c3bbe5b646acb43b081', 'request_id': 'req-7b30f1b4-d477-4cec-b6a0-264eca304c0d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:05.092936 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabc842631534c3bbe5b646acb43b081', 'request_id': 'req-7b30f1b4-d477-4cec-b6a0-264eca304c0d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:05.098564 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabc842631534c3bbe5b646acb43b081', 'request_id': 'req-7b30f1b4-d477-4cec-b6a0-264eca304c0d'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:05.111105 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] The token cache is being invalidate because project fabc842631534c3bbe5b646acb43b081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:45:05.111392 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:05.112007 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-7b30f1b4-d477-4cec-b6a0-264eca304c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:05.113541 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1450/2923] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:45:04 2022] DELETE /identity/v3/projects/fabc842631534c3bbe5b646acb43b081 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:05.118401 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55563718-275f-43c1-961d-860e60b326e3 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.118857 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55563718-275f-43c1-961d-860e60b326e3 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.118976 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55563718-275f-43c1-961d-860e60b326e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.139280 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-55563718-275f-43c1-961d-860e60b326e3 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:05.140507 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-55563718-275f-43c1-961d-860e60b326e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:05.200042 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1474/2924] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:05.207924 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d87b11-842c-4e53-984b-535b5d9015f6 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.208646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d87b11-842c-4e53-984b-535b5d9015f6 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.208646 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d87b11-842c-4e53-984b-535b5d9015f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.228638 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-d3d87b11-842c-4e53-984b-535b5d9015f6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:05.229872 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-d3d87b11-842c-4e53-984b-535b5d9015f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:05.247956 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1451/2925] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:05.249162 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55563718-275f-43c1-961d-860e60b326e3 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:05.259719 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55563718-275f-43c1-961d-860e60b326e3 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:05.264374 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1228b-1352-4ffa-9d95-2d534739db0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:05.264999 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1228b-1352-4ffa-9d95-2d534739db0a admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.265281 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1228b-1352-4ffa-9d95-2d534739db0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.265556 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1228b-1352-4ffa-9d95-2d534739db0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.266221 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1228b-1352-4ffa-9d95-2d534739db0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:45:05.266544 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1228b-1352-4ffa-9d95-2d534739db0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:05.268173 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1228b-1352-4ffa-9d95-2d534739db0a admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:05.280069 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1475/2926] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 10:45:05.285387 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d87b11-842c-4e53-984b-535b5d9015f6 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:05.294717 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d87b11-842c-4e53-984b-535b5d9015f6 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:05.299409 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af0be6-c275-416e-8c5b-f7364c370a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:05.300061 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af0be6-c275-416e-8c5b-f7364c370a6b admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.300342 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af0be6-c275-416e-8c5b-f7364c370a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.300613 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af0be6-c275-416e-8c5b-f7364c370a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.301275 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af0be6-c275-416e-8c5b-f7364c370a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:05.303224 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af0be6-c275-416e-8c5b-f7364c370a6b admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:05.336103 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1452/2927] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:45:05 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:45:05.337307 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1228b-1352-4ffa-9d95-2d534739db0a admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:05.347383 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1228b-1352-4ffa-9d95-2d534739db0a admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:05.404767 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf544c-9e5f-4e96-b1cc-6bbb51dc0b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:05.405405 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf544c-9e5f-4e96-b1cc-6bbb51dc0b8f admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.405684 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf544c-9e5f-4e96-b1cc-6bbb51dc0b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.405954 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf544c-9e5f-4e96-b1cc-6bbb51dc0b8f admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.406582 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf544c-9e5f-4e96-b1cc-6bbb51dc0b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:05.408473 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf544c-9e5f-4e96-b1cc-6bbb51dc0b8f admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:05.429891 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1476/2928] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:45:05 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 10:45:05.434017 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af0be6-c275-416e-8c5b-f7364c370a6b admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:05.445366 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af0be6-c275-416e-8c5b-f7364c370a6b admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:05.460365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88dfb8-038a-4d1d-92bb-a2d561837e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:05.461245 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88dfb8-038a-4d1d-92bb-a2d561837e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.465715 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88dfb8-038a-4d1d-92bb-a2d561837e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.465715 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88dfb8-038a-4d1d-92bb-a2d561837e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.466297 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88dfb8-038a-4d1d-92bb-a2d561837e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:05.467921 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88dfb8-038a-4d1d-92bb-a2d561837e7d admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:05.478839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1453/2929] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:45:05.484244 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf544c-9e5f-4e96-b1cc-6bbb51dc0b8f admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:05.497488 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf544c-9e5f-4e96-b1cc-6bbb51dc0b8f admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:05.502646 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236deda9-f15c-4472-9a93-0ada1ad56994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:05.503853 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236deda9-f15c-4472-9a93-0ada1ad56994 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.504134 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236deda9-f15c-4472-9a93-0ada1ad56994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.504408 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236deda9-f15c-4472-9a93-0ada1ad56994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.505075 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236deda9-f15c-4472-9a93-0ada1ad56994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:05.506679 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236deda9-f15c-4472-9a93-0ada1ad56994 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:05.520983 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1477/2930] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:45:05.524270 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88dfb8-038a-4d1d-92bb-a2d561837e7d admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:05.535693 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88dfb8-038a-4d1d-92bb-a2d561837e7d admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:05.541656 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10bc7e-1634-4a9a-82fd-3f8fa5cf8718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:05.542325 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10bc7e-1634-4a9a-82fd-3f8fa5cf8718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.542608 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10bc7e-1634-4a9a-82fd-3f8fa5cf8718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.543009 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10bc7e-1634-4a9a-82fd-3f8fa5cf8718 admin admin] PATH_INFO: `/v3/projects/f7d1d13bdfe84a78b073058361dce5a9/users/7556932a549d4b21a67aa3937869837d/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.558365 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10bc7e-1634-4a9a-82fd-3f8fa5cf8718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d1d13bdfe84a78b073058361dce5a9, user_id=7556932a549d4b21a67aa3937869837d, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:05.561630 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10bc7e-1634-4a9a-82fd-3f8fa5cf8718 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:05.574498 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1454/2931] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:45:05 2022] PUT /identity/v3/projects/f7d1d13bdfe84a78b073058361dce5a9/users/7556932a549d4b21a67aa3937869837d/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:05.585094 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcb68b-a70d-4cdf-a387-b06242a66e9c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.585385 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcb68b-a70d-4cdf-a387-b06242a66e9c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.585658 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcb68b-a70d-4cdf-a387-b06242a66e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.613365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-1ebcb68b-a70d-4cdf-a387-b06242a66e9c None None] MFA Rules not processed for user `7556932a549d4b21a67aa3937869837d`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:05.614667 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1ebcb68b-a70d-4cdf-a387-b06242a66e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:05.662080 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:05.679623 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1478/2932] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:05.691858 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10bc7e-1634-4a9a-82fd-3f8fa5cf8718 admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:05.693523 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-2e10bc7e-1634-4a9a-82fd-3f8fa5cf8718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:05.731842 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:05.774502 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10bc7e-1634-4a9a-82fd-3f8fa5cf8718 admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:05.778124 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28d57d-4751-4282-94aa-8501725f029b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfef506919f4914a7883bd99ea07615', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:05.778774 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28d57d-4751-4282-94aa-8501725f029b service glance] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:05.779002 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28d57d-4751-4282-94aa-8501725f029b service glance] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:05.779272 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28d57d-4751-4282-94aa-8501725f029b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:05.787326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28d57d-4751-4282-94aa-8501725f029b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:05.788737 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28d57d-4751-4282-94aa-8501725f029b service glance] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:05.797327 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1455/2933] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:45:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:45:15.676696 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=4 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:15.793534 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=20 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:25.221657 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcb68b-a70d-4cdf-a387-b06242a66e9c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:25.223104 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-1ebcb68b-a70d-4cdf-a387-b06242a66e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:25.319963 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcb68b-a70d-4cdf-a387-b06242a66e9c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:25.325183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:25.326090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:25.326372 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:25.326642 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] PATH_INFO: `/v3/users/cf22d3aa1f254eb8ac59e777be927d4d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:25.327865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf22d3aa1f254eb8ac59e777be927d4d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:25.329830 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:25.384165 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf22d3aa1f254eb8ac59e777be927d4d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:25.384813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf22d3aa1f254eb8ac59e777be927d4d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:25.391678 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf22d3aa1f254eb8ac59e777be927d4d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:25.403393 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf22d3aa1f254eb8ac59e777be927d4d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:25.403952 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf22d3aa1f254eb8ac59e777be927d4d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:25.417079 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1479/2934] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:45:25 2022] DELETE /identity/v3/users/cf22d3aa1f254eb8ac59e777be927d4d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:25.588915 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28d57d-4751-4282-94aa-8501725f029b service glance] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:25.601600 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28d57d-4751-4282-94aa-8501725f029b service glance] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:25.660780 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:25.661416 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:25.661839 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:25.662204 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] PATH_INFO: `/v3/projects/9eff73c6ea0846a383f50b228aeb2432` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:25.663304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eff73c6ea0846a383f50b228aeb2432)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:25.665254 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:25.709379 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eff73c6ea0846a383f50b228aeb2432', 'request_id': 'req-6ffa623b-8085-4dfe-bb40-929493bdf4e2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:25.715200 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eff73c6ea0846a383f50b228aeb2432', 'request_id': 'req-6ffa623b-8085-4dfe-bb40-929493bdf4e2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:25.721127 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eff73c6ea0846a383f50b228aeb2432', 'request_id': 'req-6ffa623b-8085-4dfe-bb40-929493bdf4e2'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:25.732803 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] The token cache is being invalidate because project 9eff73c6ea0846a383f50b228aeb2432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:45:25.733121 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:25.733753 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-6ffa623b-8085-4dfe-bb40-929493bdf4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:25.735184 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1456/2935] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:45:25 2022] DELETE /identity/v3/projects/9eff73c6ea0846a383f50b228aeb2432 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:33.629826 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:33.631284 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:33.644608 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf789d-025b-4c9f-a3ce-3e4918195ba5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:33.701183 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:33.701813 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:33.702093 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:33.702365 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] PATH_INFO: `/v3/users/7556932a549d4b21a67aa3937869837d` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:33.703494 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7556932a549d4b21a67aa3937869837d)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:33.705442 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:33.726030 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:33.753920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7556932a549d4b21a67aa3937869837d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:33.754559 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7556932a549d4b21a67aa3937869837d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:33.761468 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7556932a549d4b21a67aa3937869837d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:33.773185 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7556932a549d4b21a67aa3937869837d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:33.773850 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7556932a549d4b21a67aa3937869837d'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:33.789195 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1480/2936] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:45:33 2022] DELETE /identity/v3/users/7556932a549d4b21a67aa3937869837d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:33.793729 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669323-5e6f-43e6-8e8c-da263370c437 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:33.794697 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669323-5e6f-43e6-8e8c-da263370c437 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:33.794997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89669323-5e6f-43e6-8e8c-da263370c437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:33.814612 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-89669323-5e6f-43e6-8e8c-da263370c437 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:33.815806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-89669323-5e6f-43e6-8e8c-da263370c437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:33.871940 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1457/2937] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:33.882198 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:33.883600 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:33.939472 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a67cf-7cf0-43ef-863b-5845a90455d4 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:33.943090 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9b857-7acf-4419-90be-8f47a57ac5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:33.943940 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9b857-7acf-4419-90be-8f47a57ac5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:33.944215 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9b857-7acf-4419-90be-8f47a57ac5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:33.944483 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9b857-7acf-4419-90be-8f47a57ac5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:33.953216 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9b857-7acf-4419-90be-8f47a57ac5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:33.954605 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9b857-7acf-4419-90be-8f47a57ac5e8 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:33.963804 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1481/2938] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:45:34.221473 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89669323-5e6f-43e6-8e8c-da263370c437 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:34.223038 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-89669323-5e6f-43e6-8e8c-da263370c437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:34.235140 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89669323-5e6f-43e6-8e8c-da263370c437 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:34.239650 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:34.240273 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.240549 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.240818 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] PATH_INFO: `/v3/projects/f7d1d13bdfe84a78b073058361dce5a9` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.241957 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d1d13bdfe84a78b073058361dce5a9)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:34.243843 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:34.275019 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:34.292733 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d1d13bdfe84a78b073058361dce5a9', 'request_id': 'req-c6d84431-d989-4b1f-9b44-08e726a12389'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:34.298946 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d1d13bdfe84a78b073058361dce5a9', 'request_id': 'req-c6d84431-d989-4b1f-9b44-08e726a12389'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:34.304423 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d1d13bdfe84a78b073058361dce5a9', 'request_id': 'req-c6d84431-d989-4b1f-9b44-08e726a12389'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:34.317412 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] The token cache is being invalidate because project f7d1d13bdfe84a78b073058361dce5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:45:34.317704 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:34.318593 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-c6d84431-d989-4b1f-9b44-08e726a12389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:45:34.320047 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1458/2939] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:45:34 2022] DELETE /identity/v3/projects/f7d1d13bdfe84a78b073058361dce5a9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:34.324865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035542f-9167-4830-bc02-d3e5c764b9b6 None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.325200 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035542f-9167-4830-bc02-d3e5c764b9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.326004 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035542f-9167-4830-bc02-d3e5c764b9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.344807 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-7035542f-9167-4830-bc02-d3e5c764b9b6 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:34.346036 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-7035542f-9167-4830-bc02-d3e5c764b9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:34.407039 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1482/2940] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:34.414635 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d4d4a-6b4b-40cc-8d49-ec6c87f16cc7 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.414922 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d4d4a-6b4b-40cc-8d49-ec6c87f16cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.415197 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d4d4a-6b4b-40cc-8d49-ec6c87f16cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.435670 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-510d4d4a-6b4b-40cc-8d49-ec6c87f16cc7 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:34.436868 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-510d4d4a-6b4b-40cc-8d49-ec6c87f16cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:34.444939 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1459/2941] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:34.449213 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035542f-9167-4830-bc02-d3e5c764b9b6 None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:34.459522 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035542f-9167-4830-bc02-d3e5c764b9b6 None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:34.464089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deef8fa-443d-4831-bd80-124bfc28b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:34.464681 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deef8fa-443d-4831-bd80-124bfc28b17c admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.464993 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deef8fa-443d-4831-bd80-124bfc28b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.465273 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deef8fa-443d-4831-bd80-124bfc28b17c admin admin] PATH_INFO: `/v3/domains` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.465920 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deef8fa-443d-4831-bd80-124bfc28b17c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 10:45:34.466225 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deef8fa-443d-4831-bd80-124bfc28b17c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:34.467803 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deef8fa-443d-4831-bd80-124bfc28b17c admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:34.479068 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1483/2942] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 10:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 10:45:34.483793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d4d4a-6b4b-40cc-8d49-ec6c87f16cc7 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:34.492980 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d4d4a-6b4b-40cc-8d49-ec6c87f16cc7 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:34.498686 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a873ac-1a19-4458-8497-98bad1d49cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:34.499278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a873ac-1a19-4458-8497-98bad1d49cff admin admin] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.499555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a873ac-1a19-4458-8497-98bad1d49cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.499824 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a873ac-1a19-4458-8497-98bad1d49cff admin admin] PATH_INFO: `/v3/projects` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.500455 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a873ac-1a19-4458-8497-98bad1d49cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:34.502369 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a873ac-1a19-4458-8497-98bad1d49cff admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:34.528219 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1460/2943] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 10:45:34 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:45:34.532267 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deef8fa-443d-4831-bd80-124bfc28b17c admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:34.542275 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deef8fa-443d-4831-bd80-124bfc28b17c admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:34.568575 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:34.602181 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53417211-01ff-40df-8f84-e116ad353a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:34.602789 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53417211-01ff-40df-8f84-e116ad353a80 admin admin] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.603073 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53417211-01ff-40df-8f84-e116ad353a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.603345 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53417211-01ff-40df-8f84-e116ad353a80 admin admin] PATH_INFO: `/v3/users` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.603973 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53417211-01ff-40df-8f84-e116ad353a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:34.605914 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53417211-01ff-40df-8f84-e116ad353a80 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:34.626715 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1484/2944] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 10:45:34 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 10:45:34.630793 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a873ac-1a19-4458-8497-98bad1d49cff admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:34.641752 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a873ac-1a19-4458-8497-98bad1d49cff admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:34.646376 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3132b-3395-4e8a-b975-918d1391c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:34.646997 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3132b-3395-4e8a-b975-918d1391c24e admin admin] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.647278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3132b-3395-4e8a-b975-918d1391c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.647570 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3132b-3395-4e8a-b975-918d1391c24e admin admin] PATH_INFO: `/v3/roles` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.648207 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3132b-3395-4e8a-b975-918d1391c24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:34.649901 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3132b-3395-4e8a-b975-918d1391c24e admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:34.660241 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1461/2945] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:45:34.664233 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53417211-01ff-40df-8f84-e116ad353a80 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:34.674485 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53417211-01ff-40df-8f84-e116ad353a80 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:34.679129 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af031209-b7c8-4fad-9250-95bb9419b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:34.679742 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031209-b7c8-4fad-9250-95bb9419b9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.680024 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031209-b7c8-4fad-9250-95bb9419b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.680296 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af031209-b7c8-4fad-9250-95bb9419b9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.680931 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af031209-b7c8-4fad-9250-95bb9419b9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:34.682523 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af031209-b7c8-4fad-9250-95bb9419b9a9 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:34.692255 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1485/2946] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 10:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 10:45:34.696480 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3132b-3395-4e8a-b975-918d1391c24e admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:34.706875 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3132b-3395-4e8a-b975-918d1391c24e admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:34.711852 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d729d-405a-44fc-8cf4-e7f37ac1b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:34.712519 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d729d-405a-44fc-8cf4-e7f37ac1b98a admin admin] REQUEST_METHOD: `PUT` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.712802 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d729d-405a-44fc-8cf4-e7f37ac1b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.713119 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d729d-405a-44fc-8cf4-e7f37ac1b98a admin admin] PATH_INFO: `/v3/projects/3e0a58f5f1044e7cb110e12b056654d6/users/cfb00130d0f443f1b46b6c418a207dee/roles/d598e7097e2d496f971598b09965388a` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.731467 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d729d-405a-44fc-8cf4-e7f37ac1b98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0a58f5f1044e7cb110e12b056654d6, user_id=cfb00130d0f443f1b46b6c418a207dee, role_id=d598e7097e2d496f971598b09965388a)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:34.734299 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d729d-405a-44fc-8cf4-e7f37ac1b98a admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:34.747606 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1462/2947] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 10:45:34 2022] PUT /identity/v3/projects/3e0a58f5f1044e7cb110e12b056654d6/users/cfb00130d0f443f1b46b6c418a207dee/roles/d598e7097e2d496f971598b09965388a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:45:34.758959 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3b168-82f5-4ac3-8905-0412d5bbba3c None None] REQUEST_METHOD: `POST` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.759260 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3b168-82f5-4ac3-8905-0412d5bbba3c None None] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.759560 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3b168-82f5-4ac3-8905-0412d5bbba3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.787883 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.auth.core [None req-81c3b168-82f5-4ac3-8905-0412d5bbba3c None None] MFA Rules not processed for user `cfb00130d0f443f1b46b6c418a207dee`. Rule list: `[]` (Enabled: `True`). {{(pid=81436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:45:34.789125 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-81c3b168-82f5-4ac3-8905-0412d5bbba3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:34.851914 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1486/2948] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:45:34.863005 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d729d-405a-44fc-8cf4-e7f37ac1b98a admin admin] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:45:34.864687 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-eb0d729d-405a-44fc-8cf4-e7f37ac1b98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:45:34.920145 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d729d-405a-44fc-8cf4-e7f37ac1b98a admin admin] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:45:34.923634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104bc7d-6c5b-4ec6-9255-4027c2bce689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561dd954e4184662b33ca3356aa08d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:45:34.924223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104bc7d-6c5b-4ec6-9255-4027c2bce689 service cinder] REQUEST_METHOD: `GET` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:45:34.924497 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104bc7d-6c5b-4ec6-9255-4027c2bce689 service cinder] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:45:34.924776 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104bc7d-6c5b-4ec6-9255-4027c2bce689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:45:34.932741 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104bc7d-6c5b-4ec6-9255-4027c2bce689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:45:34.934191 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104bc7d-6c5b-4ec6-9255-4027c2bce689 service cinder] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:45:34.943634 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1463/2949] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:45:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:45:44.849089 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:44.939406 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:46:07.868118 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3b168-82f5-4ac3-8905-0412d5bbba3c None None] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:46:07.930149 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3b168-82f5-4ac3-8905-0412d5bbba3c None None] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:46:07.935197 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:46:07.935822 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:46:07.936097 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:46:07.936364 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] PATH_INFO: `/v3/users/cfb00130d0f443f1b46b6c418a207dee` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:46:07.937492 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb00130d0f443f1b46b6c418a207dee)` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:46:07.939617 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:46:07.983457 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb00130d0f443f1b46b6c418a207dee'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:46:07.984088 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb00130d0f443f1b46b6c418a207dee'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:46:07.990768 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb00130d0f443f1b46b6c418a207dee'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:46:08.002919 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb00130d0f443f1b46b6c418a207dee'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:46:08.003563 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.notifications [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb00130d0f443f1b46b6c418a207dee'} {{(pid=81436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:46:08.015865 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1487/2950] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 10:46:07 2022] DELETE /identity/v3/users/cfb00130d0f443f1b46b6c418a207dee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:46:08.020326 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b2b9-4e4c-4b52-a416-d45573b58c16 None None] REQUEST_METHOD: `POST` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:46:08.020807 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b2b9-4e4c-4b52-a416-d45573b58c16 None None] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:46:08.020932 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b2b9-4e4c-4b52-a416-d45573b58c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:46:08.039115 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.auth.core [None req-f439b2b9-4e4c-4b52-a416-d45573b58c16 None None] MFA Rules not processed for user `d64b74222381414fa028861d4cb5842c`. Rule list: `[]` (Enabled: `True`). {{(pid=81437) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 10:46:08.040292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f439b2b9-4e4c-4b52-a416-d45573b58c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:46:08.097223 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1464/2951] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 10:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 10:46:08.106986 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:46:08.108495 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:46:08.165098 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b76a71-b9b4-4280-a7ed-31162fc0f0b5 admin admin] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:46:08.169205 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d09307-730f-4fc0-9fe1-6c31318c53a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0f25125b534983af66d5326f4d626d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:46:08.169811 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d09307-730f-4fc0-9fe1-6c31318c53a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:46:08.170119 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d09307-730f-4fc0-9fe1-6c31318c53a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:46:08.170391 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d09307-730f-4fc0-9fe1-6c31318c53a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:46:08.179154 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d09307-730f-4fc0-9fe1-6c31318c53a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:46:08.180568 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d09307-730f-4fc0-9fe1-6c31318c53a5 service neutron] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:46:08.190873 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1488/2952] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:46:08.449292 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439b2b9-4e4c-4b52-a416-d45573b58c16 None None] Authenticating user token {{(pid=81437) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:46:08.450806 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.fernet_utils [None req-f439b2b9-4e4c-4b52-a416-d45573b58c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81437) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:46:08.463665 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439b2b9-4e4c-4b52-a416-d45573b58c16 None None] Validating token access rules against request {{(pid=81437) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:46:08.468339 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64b74222381414fa028861d4cb5842c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5634981824594276a0bd3022cd78b5df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81437) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:46:08.468994 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:46:08.469278 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:46:08.469555 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] PATH_INFO: `/v3/projects/3e0a58f5f1044e7cb110e12b056654d6` {{(pid=81437) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:46:08.471050 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0a58f5f1044e7cb110e12b056654d6)` {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:46:08.472935 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] RBAC: Authorization granted {{(pid=81437) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:46:08.519316 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0a58f5f1044e7cb110e12b056654d6', 'request_id': 'req-8853d8e4-1030-4549-93ee-15efb64794b1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:46:08.525259 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0a58f5f1044e7cb110e12b056654d6', 'request_id': 'req-8853d8e4-1030-4549-93ee-15efb64794b1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:46:08.531304 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0a58f5f1044e7cb110e12b056654d6', 'request_id': 'req-8853d8e4-1030-4549-93ee-15efb64794b1'} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:46:08.543836 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] The token cache is being invalidate because project 3e0a58f5f1044e7cb110e12b056654d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81437) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 10:46:08.544125 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:46:08.544744 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG keystone.notifications [None req-8853d8e4-1030-4549-93ee-15efb64794b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81437) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 10:46:08.546249 dv-cinder-844563-7-smb devstack@keystone.service[81437]: [pid: 81437|app: 0|req: 1465/2953] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 10:46:08 2022] DELETE /identity/v3/projects/3e0a58f5f1044e7cb110e12b056654d6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 10:46:18.186376 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:46:18.540227 dv-cinder-844563-7-smb devstack@keystone.service[81437]: DEBUG dbcounter [-] [81437] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:46:59.403287 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d09307-730f-4fc0-9fe1-6c31318c53a5 service neutron] Authenticating user token {{(pid=81436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 10:46:59.404673 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-b8d09307-730f-4fc0-9fe1-6c31318c53a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:46:59.475823 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d09307-730f-4fc0-9fe1-6c31318c53a5 service neutron] Validating token access rules against request {{(pid=81436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 10:46:59.534247 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10db4b-f2e1-43ab-9833-0a427a817393 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794990333d3748abad7683590b0e5d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2beda4474ea544dba1eee3f14ae299a8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 10:46:59.534851 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10db4b-f2e1-43ab-9833-0a427a817393 service placement] REQUEST_METHOD: `GET` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 10:46:59.535133 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10db4b-f2e1-43ab-9833-0a427a817393 service placement] SCRIPT_NAME: `/identity` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 10:46:59.535404 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10db4b-f2e1-43ab-9833-0a427a817393 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 10:46:59.537157 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.fernet_utils [None req-3e10db4b-f2e1-43ab-9833-0a427a817393 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 10:46:59.548288 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10db4b-f2e1-43ab-9833-0a427a817393 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 10:46:59.549867 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10db4b-f2e1-43ab-9833-0a427a817393 service placement] RBAC: Authorization granted {{(pid=81436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 10:46:59.560554 dv-cinder-844563-7-smb devstack@keystone.service[81436]: [pid: 81436|app: 0|req: 1489/2954] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 10:46:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 10:47:09.556231 dv-cinder-844563-7-smb devstack@keystone.service[81436]: DEBUG dbcounter [-] [81436] Writing DB stats keystone:SELECT=58 {{(pid=81436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}